- 03 Apr, 2021 2 commits
-
-
Deepak Narayanan authored
-
Mohammad Shoeybi authored
Pipeline refactor See merge request ADLR/megatron-lm!254
-
- 02 Apr, 2021 1 commit
-
-
Jared Casper authored
-
- 31 Mar, 2021 2 commits
-
-
Mohammad Shoeybi authored
removed the checks for bfloat jitting See merge request ADLR/megatron-lm!255
-
mshoeybi authored
-
- 24 Mar, 2021 3 commits
-
-
Jared Casper authored
-
Jared Casper authored
-
Vijay Korthikanti authored
-
- 23 Mar, 2021 1 commit
-
-
Jared Casper authored
Make sure pipeline-model-parallel size is greater than 2 for interleaved schedule See merge request ADLR/megatron-lm!253
-
- 20 Mar, 2021 1 commit
-
-
Deepak Narayanan authored
-
- 19 Mar, 2021 4 commits
-
-
Jared Casper authored
ICT zeroshot evaluation See merge request ADLR/megatron-lm!248
-
Mostofa Patwary authored
-
Jared Casper authored
Bfloat fused softmax + fused layer norm See merge request ADLR/megatron-lm!251
-
Mohammad Shoeybi authored
-
- 18 Mar, 2021 2 commits
-
-
Jared Casper authored
refactored the fused kernels build See merge request ADLR/megatron-lm!250
-
Mohammad Shoeybi authored
-
- 17 Mar, 2021 2 commits
-
-
Jared Casper authored
softmax data load/store optimization See merge request ADLR/megatron-lm!249
-
Vijay Korthikanti authored
-
- 16 Mar, 2021 2 commits
-
-
Vijay Korthikanti authored
-
Vijay Korthikanti authored
-
- 08 Mar, 2021 2 commits
-
-
Jared Casper authored
Bfloat with fp32 grad acc See merge request ADLR/megatron-lm!247
-
Mohammad Shoeybi authored
-
- 04 Mar, 2021 6 commits
-
-
Jared Casper authored
Rc debug underflow See merge request ADLR/megatron-lm!246
-
Rewon Child authored
-
Rewon Child authored
-
Rewon Child authored
-
Rewon Child authored
-
Rewon Child authored
-
- 03 Mar, 2021 6 commits
-
-
Jared Casper authored
Retrieval index building See merge request ADLR/megatron-lm!239
-
Jared Casper authored
Get PyTorch batched communication API working for interleaved schedule See merge request ADLR/megatron-lm!242
-
Jared Casper authored
Remove pipeline stall timing See merge request ADLR/megatron-lm!244
-
Deepak Narayanan authored
-
Deepak Narayanan authored
-
Deepak Narayanan authored
-
- 27 Feb, 2021 1 commit
-
-
Jared Casper authored
Fix deadlock when get_num_microbatches() < pipeline-parallel size See merge request ADLR/megatron-lm!243
-
- 26 Feb, 2021 3 commits
-
-
Deepak Narayanan authored
Fix deadlock when get_num_microbatches() < pipeline-parallel size (don't try to measure pipeline stall)
-
Jared Casper authored
Support Torch DDP for single-stage, num_microbatches() > 1 See merge request ADLR/megatron-lm!240
-
Deepak Narayanan authored
-
- 25 Feb, 2021 2 commits
-
-
Mohammad Shoeybi authored
Don't import deprecated model from realm_model which is broken. See merge request ADLR/megatron-lm!241
-
Jared Casper authored
-
