"llm/utils.go" did not exist on "a3ec1ec2a0d210f9bd1991f2878dcb278f36f6f4"
- 13 Feb, 2021 1 commit
-
-
Deepak Narayanan authored
-
- 10 Feb, 2021 2 commits
-
-
Deepak Narayanan authored
-
Deepak Narayanan authored
-
- 09 Feb, 2021 2 commits
-
-
Deepak Narayanan authored
-
Deepak Narayanan authored
- Split a model's computation into multiple virtual stages as needed, and schedule communication correctly between these virtual stages - Move schedule code into `schedules.py` and communication code into `p2p_communication.py` - Use hyphens instead of spaces in all time logging for consistency - Factor out code in megatron/training.py into helper functions - Refactor evaluate() function: make it use forward_backward_schedule functions
-