• jjsjann123's avatar
    [sync BN] (#792) · 1ff54b8f
    jjsjann123 authored
    * [sync BN]
    
    support non-uniform batch size across process group.
    
    TODO: test should be added once cleaned up.
    
    * updating unit tests
    
    * new unit tests for different inputs
    
    * cleaning
    1ff54b8f
syncbn.cpp 6.11 KB