"megatron/inference/text_generation/__init__.py" did not exist on "abe36e2e5fb9104eca2456945e12b49f93fce475"
-
Deepak Narayanan authored
Also includes following changes for inter-layer model-parallel implementation: - Refactoring of model implementations - Training loop changes to support inter-layer communication using `ring_exchange` - New groups for inter-layer communication - Checkpoint changes - Command line arguments
7abd3e90
