- 17 Feb, 2023 1 commit
-
-
Maanu Grover authored
-
- 06 Jul, 2021 1 commit
-
-
Robert Clark authored
The --seq-length argument was missing from the example distributed BERT pre-training script which throws an error while attempting to parse the arguments as the code expects all arguments to be specified and have a non-None value. Signed-Off-By:Robert Clark <roclark@nvidia.com>
-
- 14 May, 2021 1 commit
-
-
Jared Casper authored
-
- 12 Jan, 2021 1 commit
-
-
Mohammad Shoeybi authored
-
- 13 Nov, 2020 1 commit
-
-
Deepak Narayanan authored
-
- 12 Nov, 2020 2 commits
-
-
Deepak Narayanan authored
-
Deepak Narayanan authored
Also includes following changes for inter-layer model-parallel implementation: - Refactoring of model implementations - Training loop changes to support inter-layer communication using `ring_exchange` - New groups for inter-layer communication - Checkpoint changes - Command line arguments
-
- 16 Apr, 2020 2 commits
- 08 Apr, 2020 1 commit
-
-
Jared Casper authored
-
- 30 Jul, 2019 1 commit
-
-
Raul Puri authored
Co-authored-by:
shoeybi <shoeybim@gmail.com> Co-authored-by:
raulpuric <raulpuric@berkeley.edu> Co-authored-by:
jaredcasper <jaredcasper@gmail.com> Co-authored-by:
mpatwary <mostofa.patwary@gmail.com> Co-authored-by:
plegresl <plegresl@gmail.com>
-
- 13 May, 2019 1 commit
-
-
Raul Puri authored
-
- 27 Mar, 2019 1 commit
-
-
Raul Puri authored
-