Commits · 4947002db7eaea6d3c4aabf42adc9e48605ac52a · OpenDAS / Megatron-LM

"vscode:/vscode.git/clone" did not exist on "a7e93c15ce14c3ed39aa3016742660805e7875aa"

08 Oct, 2019 2 commits
- Merge branch 'torchddp' into 'master' · 4947002d
  Mohammad Shoeybi authored Oct 07, 2019
```
Use DDP command line argument instead of source flag in pretrain_bert.py.

See merge request ADLR/megatron-lm!2
```
  4947002d
- Use DDP command line argument instead of source flag in pretrain_bert.py. · 72c5f666
  Jared Casper authored Oct 07, 2019
```
Note that there is currently an issue with bert using Torch DDP.
```
  72c5f666
07 Oct, 2019 2 commits
- Merge branch 'staging' into 'master' · a54978bb
  Jared Casper authored Oct 07, 2019
```
Updating public repo with latest changes.

See merge request ADLR/megatron-lm!1
```
  a54978bb
- Add licence to split script. · 5d402eb4
  Jared Casper authored Oct 07, 2019
  
  5d402eb4
04 Oct, 2019 1 commit
- Updating public repo with latest changes. · a1d04b79
  Jared Casper authored Oct 04, 2019
  
  a1d04b79
12 Sep, 2019 2 commits
- added missing valid-data line (#9) · 93ab4bea
  Raul Puri authored Sep 12, 2019
  
  93ab4bea
- Support latest PyTorch RNG state API. (#8) · 2ef23675
  Jared Casper authored Sep 11, 2019
```
Fixes #7.
```
  2ef23675
13 Aug, 2019 1 commit
- eval+numeric update · a0368ddf
  Raul Puri authored Aug 12, 2019
  
  a0368ddf
30 Jul, 2019 1 commit

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e

14 May, 2019 1 commit
- fixed save race condition · 0399d32c
  Raul Puri authored May 14, 2019
  
  0399d32c
13 May, 2019 1 commit
- added presplit-sentences to scripts · 3573423f
  Raul Puri authored May 13, 2019
  
  3573423f
11 May, 2019 1 commit
- added missing presplit_sentences_json.py · d0878333
  Raul Puri authored May 11, 2019
  
  d0878333
23 Apr, 2019 1 commit

Faster dataloader merge () · 66719e97

Raul Puri authored Apr 23, 2019

* threaded tf_dl+presplit sentences+shuffled dataset with resume

* elaborate in readme

66719e97

27 Mar, 2019 1 commit
- initial commit · fb4cbdc2
  Raul Puri authored Mar 27, 2019
  
  fb4cbdc2