[pipeline] refactor gpt2 pipeline forwards (#4287)

* move gpt2 pipeline forwards to modeling folder * check pipeline status when adding replacing policy * fix typehint * fix arguments processing in gpt2_model_forward

[pipeline] refactor gpt2 pipeline forwards (#4287)
* move gpt2 pipeline forwards to modeling folder * check pipeline status when adding replacing policy * fix typehint * fix arguments processing in gpt2_model_forward
b774d5ea · Baizhou Zhang · Hongxin Liu · d921ce83 · b774d5ea · b774d5ea
Commit b774d5ea authored Jul 20, 2023 by Baizhou Zhang Committed by Hongxin Liu Aug 15, 2023
Showing with 718 additions and 709 deletions

colossalai/shardformer/modeling/gpt2.py colossalai/shardformer/modeling/gpt2.py +668 -0

colossalai/shardformer/policies/gpt2.py colossalai/shardformer/policies/gpt2.py +50 -709

No files found.
--- a/colossalai/shardformer/modeling/gpt2.py
+++ b/colossalai/shardformer/modeling/gpt2.py
--- a/colossalai/shardformer/policies/gpt2.py
+++ b/colossalai/shardformer/policies/gpt2.py