• Jianghai's avatar
    [pipeline] rewrite bert tests and fix some bugs (#4409) · 7596e9ae
    Jianghai authored
    * add pipeline policy and bert forward to be done
    
    * add bertmodel pipeline forward and make tests
    
    * add Bert_Policy and test for policy
    
    * update formatting
    
    * update formatting
    
    * update the code
    
    * fix bugs
    
    * fix name confilt
    
    * add bloom model and policy ,revise the base class of policy
    
    * revise
    
    * revision
    
    * add bert_for_pretraining
    
    * add bert_for_pretraining forward and policy
    
    * fix typos
    
    * cancel warning
    
    * change the imediate output to default dict
    
    * change the default output of get_shared_params
    
    * rewrite bert test
    
    * rewrite bert test
    
    * fix some bugs
    
    * del pipeline tests
    
    * del pipeline tests
    
    * del useless print
    
    * del useless print
    
    * rewrite data repeats
    7596e9ae
_utils.py 10.2 KB