• eqy's avatar
    Async pipeline parallel (#1373) · 3fe35211
    eqy authored
    * initial check in
    
    * fix
    
    * fix test
    
    * address some review comments and cleanup
    
    * fix
    
    * bookmark
    
    * fix sync placement to come before gather
    
    * similar fix for non-gather case
    
    * add async bert
    
    * update gpt minimal test
    
    * allow selection of default pp test
    
    * fix bert test
    
    * cleanup
    
    * cleanup
    3fe35211
common.py 15.2 KB