"tests/models/gpt2/test_modeling_gpt2.py" did not exist on "0c55a384f86a41baad87b90faf865537f7844bf1"
- 12 Nov, 2020 1 commit
-
-
Deepak Narayanan authored
Also includes following changes for inter-layer model-parallel implementation: - Refactoring of model implementations - Training loop changes to support inter-layer communication using `ring_exchange` - New groups for inter-layer communication - Checkpoint changes - Command line arguments
-
- 16 Apr, 2020 2 commits
