"lightx2v/vscode:/vscode.git/clone" did not exist on "4a9f0df5e60b7ecdd5a65ce1958d87f88dfbef09"
-
Deepak Narayanan authored
- Split a model's computation into multiple virtual stages as needed, and schedule communication correctly between these virtual stages - Move schedule code into `schedules.py` and communication code into `p2p_communication.py` - Use hyphens instead of spaces in all time logging for consistency - Factor out code in megatron/training.py into helper functions - Refactor evaluate() function: make it use forward_backward_schedule functions
dd889062
