tests/kit/model_zoo/transformers/gpt.py · b1feeced8e9d6b619ef62f1a473e72b5f36c9361 · OpenDAS / ColossalAI · GitLab

Find file Blame History Permalink

[shardformer] add util functions for shardformer tests/fix sync_shared_param (#4366) · b1feeced
Baizhou Zhang authored Aug 03, 2023
```
* add util functions for shardformer tests & rewrite gpt2 test

* fix shared_params & embedding/merging

* fix precision
```
b1feeced

gpt.py 4.95 KB