"scripts/write_out.py" did not exist on "1b35f6b9a34fd3991c5fbad9ce06c9c75ac65516"
-
Deepak Narayanan authored
Also includes following changes for inter-layer model-parallel implementation: - Refactoring of model implementations - Training loop changes to support inter-layer communication using `ring_exchange` - New groups for inter-layer communication - Checkpoint changes - Command line arguments
7abd3e90
