Skip to content

GitLab

Switch branch/tag
Find file BlameHistoryPermalink
  • Hongxin Liu's avatar
    [shardformer] support inplace sharding (#4251) · d921ce83
    Hongxin Liu authored 
    * [shardformer] embedding support inplace sharding

* [shardformer] linear support inplace sharding

* [shardformer] layernorm support inplace sharding

* [shardformer] qkv support inplace sharding

* [test] update shardformer layer test

* [shardformer] fix shared param sharding

* [shardformer] fix bert policy

* [shardformer] fix bloom policy

* [shardformer] fix llama policy

* [shardformer] fix opt policy

* [shardformer] fix t5 policy

* [shardformer] fix fused qkv linear

* [shardformer] fix bugs

* force sync

* [test] fix bugs

* [test] fix transformer version
    d921ce83
requirements-test.txt 543 Bytes