tests/test_modeling_gpt2.py · a42f62d34f7b2acdb7298e586adbe9f0f28864ea · chenpangpang / transformers

Adding gradient checkpointing to GPT2 (#7446) · 9e9a1fb8

Teven authored Sep 29, 2020



* GPT2 gradient checkpointing

* find_unused_parameters removed if checkpointing

* find_unused_parameters removed if checkpointing

* Update src/transformers/configuration_gpt2.py
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

* Added a test for generation with checkpointing

* Update src/transformers/configuration_gpt2.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

9e9a1fb8

test_modeling_gpt2.py 16.7 KB

Replace test_modeling_gpt2.py