• Hongxin Liu's avatar
    [plugin] add 3d parallel plugin (#4295) · 261eab02
    Hongxin Liu authored
    * [amp] add mixed precision optimizer
    
    * [plugin] add 3d parallel plugin
    
    * [booster] support pipeline
    
    * [plugin] 3d parallel plugin support clip grad norm
    
    * [shardformer] fix sharder and add plugin test
    
    * [plugin] rename 3d parallel plugin
    
    * [ci] support testmon core pkg change detection (#4305)
    
    * [hotfix] debug testmon
    
    * [hotfix] fix llama
    
    * [hotfix] fix p2p bugs
    
    * [hotfix] fix requirements
    261eab02
mixed_precision_optimizer.py 5.93 KB