"vscode:/vscode.git/clone" did not exist on "b749df609ddc348d3a72300d83e582bea869fdf8"
-
Deepak Narayanan authored
Also includes following changes for inter-layer model-parallel implementation: - Refactoring of model implementations - Training loop changes to support inter-layer communication using `ring_exchange` - New groups for inter-layer communication - Checkpoint changes - Command line arguments
7abd3e90