- 09 Feb, 2022 1 commit
-
-
Lawrence McAfee authored
-
- 29 Jan, 2022 4 commits
-
-
Jared Casper authored
second phase of vision code merge See merge request ADLR/megatron-lm!381
-
Vijay Korthikanti authored
-
Jared Casper authored
Combination of several github PRs See merge request ADLR/megatron-lm!383
-
Jared Casper authored
-
- 28 Jan, 2022 9 commits
-
-
-
-
-
-
-
-
-
Vijay Korthikanti authored
-
Vijay Korthikanti authored
-
- 27 Jan, 2022 4 commits
-
-
Vijay Korthikanti authored
-
Jared Casper authored
Distributed checkpointing memory fix See merge request ADLR/megatron-lm!379
-
Stas Bekman authored
-
Stas Bekman authored
The paper has this info, so proposing to copy it next to the table. Otherwise it's hard to guess whether you used 40GB A100s or 80GB ones (and secondary, n_gpus per node). Thank you!
-
- 26 Jan, 2022 2 commits
-
-
Lawrence McAfee authored
-
Vijay Korthikanti authored
-
- 25 Jan, 2022 2 commits
-
-
Jared Casper authored
T5 fix for deallocating pipeline output tensors See merge request ADLR/megatron-lm!380
-
Lawrence McAfee authored
-
- 24 Jan, 2022 1 commit
-
-
Vijay Korthikanti authored
-
- 22 Jan, 2022 2 commits
-
-
Jay authored
-
Vijay Korthikanti authored
-
- 20 Jan, 2022 2 commits
-
-
Jared Casper authored
Phase1 merge: vit optimizations + dataset enhancements + scaled_softmax kernel See merge request ADLR/megatron-lm!378
-
Vijay Korthikanti authored
-
- 19 Jan, 2022 2 commits
-
-
Vijay Korthikanti authored
-
Vijay Korthikanti authored
-
- 15 Jan, 2022 2 commits
-
-
Vijay Korthikanti authored
-
Vijay Korthikanti authored
-
- 14 Jan, 2022 1 commit
-
-
Vijay Korthikanti authored
-
- 13 Jan, 2022 7 commits
-
-
Lawrence McAfee authored
-
Lawrence McAfee authored
-
Lawrence McAfee authored
-
Lawrence McAfee authored
-
Lawrence McAfee authored
-
Lawrence McAfee authored
-
Vijay Korthikanti authored
-
- 12 Jan, 2022 1 commit
-
-
Vijay Korthikanti authored
-
