- 19 Mar, 2021 1 commit
-
-
Mohammad Shoeybi authored
-
- 18 Mar, 2021 1 commit
-
-
Mohammad Shoeybi authored
-
- 17 Mar, 2021 1 commit
-
-
Vijay Korthikanti authored
-
- 16 Mar, 2021 2 commits
-
-
Vijay Korthikanti authored
-
Vijay Korthikanti authored
-
- 08 Mar, 2021 1 commit
-
-
Mohammad Shoeybi authored
-
- 04 Mar, 2021 3 commits
-
-
Rewon Child authored
-
Rewon Child authored
-
Rewon Child authored
-
- 03 Mar, 2021 3 commits
-
-
Deepak Narayanan authored
-
Deepak Narayanan authored
-
Deepak Narayanan authored
-
- 26 Feb, 2021 2 commits
-
-
Deepak Narayanan authored
Fix deadlock when get_num_microbatches() < pipeline-parallel size (don't try to measure pipeline stall)
-
Deepak Narayanan authored
-
- 25 Feb, 2021 1 commit
-
-
Jared Casper authored
-
- 23 Feb, 2021 3 commits
-
-
Rewon Child authored
-
Mostofa Patwary authored
-
Vijay Korthikanti authored
-
- 22 Feb, 2021 1 commit
-
-
Deepak Narayanan authored
-
- 18 Feb, 2021 4 commits
-
-
Mostofa Patwary authored
-
Mostofa Patwary authored
-
Mostofa Patwary authored
-
Mostofa Patwary authored
-
- 17 Feb, 2021 1 commit
-
-
Deepak Narayanan authored
-
- 15 Feb, 2021 2 commits
-
-
Mostofa Patwary authored
-
Mostofa Patwary authored
-
- 13 Feb, 2021 2 commits
-
-
Deepak Narayanan authored
-
Deepak Narayanan authored
-
- 10 Feb, 2021 4 commits
-
-
Deepak Narayanan authored
-
Mostofa Patwary authored
-
Mostofa Patwary authored
-
Deepak Narayanan authored
-
- 09 Feb, 2021 4 commits
-
-
Deepak Narayanan authored
-
Deepak Narayanan authored
-
Deepak Narayanan authored
-
Deepak Narayanan authored
- Split a model's computation into multiple virtual stages as needed, and schedule communication correctly between these virtual stages - Move schedule code into `schedules.py` and communication code into `p2p_communication.py` - Use hyphens instead of spaces in all time logging for consistency - Factor out code in megatron/training.py into helper functions - Refactor evaluate() function: make it use forward_backward_schedule functions
-
- 08 Feb, 2021 1 commit
-
-
Jared Casper authored
-
- 05 Feb, 2021 2 commits
-
-
Deepak Narayanan authored
-
Vijay Korthikanti authored
-
- 04 Feb, 2021 1 commit
-
-
Vijay Korthikanti authored
-