Skip to content

GitLab

Switch branch/tag
Find file BlameHistoryPermalink
  • FoolPlayer's avatar
    [shardformer] Add layernorm (#4072) · 92f67910
    FoolPlayer authored 
    * add layernorm to bert

* add layernorm test

* add layernorm test with load state dict

* add use_mixedfusedLN in shard config

* refactor policy to support fused_layernorm
    92f67910
_utils.py 1.08 KB