"coco128/labels/train2017/000000000400.txt" did not exist on "7a81732e865753ec1acb607aa8f7e76aa8ddaa7d"
- 03 Mar, 2021 2 commits
-
-
Deepak Narayanan authored
-
Deepak Narayanan authored
-
- 26 Feb, 2021 2 commits
-
-
Deepak Narayanan authored
Fix deadlock when get_num_microbatches() < pipeline-parallel size (don't try to measure pipeline stall)
-
Deepak Narayanan authored
-
- 13 Feb, 2021 1 commit
-
-
Deepak Narayanan authored
-
- 10 Feb, 2021 2 commits
-
-
Deepak Narayanan authored
-
Deepak Narayanan authored
-
- 09 Feb, 2021 2 commits
-
-
Deepak Narayanan authored
-
Deepak Narayanan authored
- Split a model's computation into multiple virtual stages as needed, and schedule communication correctly between these virtual stages - Move schedule code into `schedules.py` and communication code into `p2p_communication.py` - Use hyphens instead of spaces in all time logging for consistency - Factor out code in megatron/training.py into helper functions - Refactor evaluate() function: make it use forward_backward_schedule functions
-