- 04 Jul, 2023 6 commits
-
-
Frank Lee authored
* [shardformer] refactored some doc and api * polish code
-
Frank Lee authored
-
Frank Lee authored
-
jiangmingyan authored
* [shardformer] shardformer support opt models * [shardformer] shardformer support opt models, fix * [shardformer] shardformer support opt models, fix * [shardformer] shardformer support opt models, fix
-
FoolPlayer authored
* add layernorm to bert * add layernorm test * add layernorm test with load state dict * add use_mixedfusedLN in shard config * refactor policy to support fused_layernorm
-
Frank Lee authored
* [shardformer] adapted T5 and LLaMa test to use kit * polish code
-