Commits · d218f9cf0de95bde467c256927e5ed676b6a6ff4 · OpenDAS / Megatron-LM

21 Apr, 2020 11 commits
- Merge branch 'master' into l2_grad_clip_fix · d218f9cf
  Mohammad authored Apr 21, 2020
  
  d218f9cf
- Merge branch 'remove_local_ddp_bcast' into 'master' · 3c709cba
  Raul Puri authored Apr 21, 2020
```
removed bcast from local ddp

See merge request ADLR/megatron-lm!72
```
  3c709cba
- removed optimized l2 grad clipping · 0b6bdca6
  Mohammad authored Apr 21, 2020
  
  0b6bdca6
- fixed a bug in l2 grad clip · 4ff2c963
  Mohammad authored Apr 20, 2020
  
  4ff2c963
- fixed a bug in l2 grad clip · fb5b2b36
  Mohammad authored Apr 20, 2020
  
  fb5b2b36
- Merge branch 'bert-vocab-chkpt' into 'master' · 73f73b81
  Mohammad Shoeybi authored Apr 20, 2020
```
Update README.md

See merge request ADLR/megatron-lm!73
```
  73f73b81
- Update README.md · 89462697
  Raul Puri authored Apr 20, 2020
  
  89462697
- Merge branch 'master' into remove_local_ddp_bcast · 97e07d64
  Mohammad authored Apr 20, 2020
  
  97e07d64
- Merge branch 'parse_known_args' into 'master' · eb0a8bf0
  Mohammad Shoeybi authored Apr 20, 2020
```
added option to ignore unknown input arguments

See merge request ADLR/megatron-lm!71
```
  eb0a8bf0
- removed bcast in local ddp · 41c1af0e
  Mohammad authored Apr 20, 2020
  
  41c1af0e
- added option to ignore unknown input arguments · 5531663b
  Mohammad authored Apr 20, 2020
  
  5531663b
20 Apr, 2020 4 commits
- Merge branch 'doc-vocab-links' into 'master' · d805e1a0
  Mohammad Shoeybi authored Apr 20, 2020
```
Doc vocab links

See merge request ADLR/megatron-lm!70
```
  d805e1a0
- Move links to download checkpoints section · b46e28bd
  Steven Steinke authored Apr 20, 2020
  
  b46e28bd
- Links to vocab in Data Preprocessing; added "WordPiece" to description · 8e4cb2a6
  Steven Steinke authored Apr 20, 2020
  
  8e4cb2a6
- Links to vocabs and merge table in Data Preprocessing · bdc3d5ba
  Steven Steinke authored Apr 20, 2020
  
  bdc3d5ba
16 Apr, 2020 25 commits
- Merge branch 'staging' into 'master' · 22c0e300
  Jared Casper authored Apr 16, 2020
```
April 2020 Release

See merge request ADLR/megatron-lm!69
```
  22c0e300
- Merge branch 'doc-updates-final' into 'staging' · acf8780b
  Mohammad Shoeybi authored Apr 16, 2020
```
Doc updates final

See merge request ADLR/megatron-lm!68
```
  acf8780b
- remove wikitext comment · 7ec42d95
  Steven Steinke authored Apr 16, 2020
  
  7ec42d95
- Fix embeddings and seq length · 475a6b99
  Steven Steinke authored Apr 16, 2020
  
  475a6b99
- Fix finetine -> tune · 5cb2d1ea
  Steven Steinke authored Apr 16, 2020
  
  5cb2d1ea
- fix typos · 50391a0b
  Steven Steinke authored Apr 16, 2020
  
  50391a0b
- RACE explained · 4f770782
  Steven Steinke authored Apr 16, 2020
  
  4f770782
- Merge branch 'staging_license' into 'staging' · 13d90b36
  Raul Puri authored Apr 16, 2020
```
Update license with Facebook's MIT code and add some clarification.

See merge request ADLR/megatron-lm!66
```
  13d90b36
- changed licence 2019 to 2020 · 463d1257
  Mohammad authored Apr 16, 2020
  
  463d1257
- make minor modifications to licnese wording · 39af7956
  Mohammad authored Apr 16, 2020
  
  39af7956
- Update README.md · d976f011
  Steven Steinke authored Apr 16, 2020
  
  d976f011
- Fixed minor inconsistencies in scripts, added distributed comment · 2e0b3fca
  Steven Steinke authored Apr 16, 2020
  
  2e0b3fca
- Update license with Facebook's MIT code and add some clarification. · 0c6f0f2d
  Jared Casper authored Apr 16, 2020
  
  0c6f0f2d
- Merge branch 'staging_docs' into 'staging' · 050c24d5
  Steven Steinke authored Apr 16, 2020
```
Staging docs

See merge request ADLR/megatron-lm!64
```
  050c24d5
- looks great · 3df23c72
  Mohammad authored Apr 16, 2020
  
  3df23c72
- latest · 0d8f1243
  Mohammad authored Apr 16, 2020
  
  0d8f1243
- latest · 1f45adcc
  Mohammad authored Apr 16, 2020
  
  1f45adcc
- updated scripts · ca19a8b5
  Mohammad authored Apr 16, 2020
  
  ca19a8b5
- made monir changes to the first two paras · fe40745e
  Mohammad authored Apr 16, 2020
  
  fe40745e
- Merge branch 'staging' into staging_docs · add35c17
  Mohammad authored Apr 16, 2020
  
  add35c17
- Merge branch 'staging_dataset_error_reporting' into 'staging' · d928dd51
  Mohammad Shoeybi authored Apr 16, 2020
```
Better error reporting when a dataset doesn't exist.

See merge request ADLR/megatron-lm!63
```
  d928dd51
- moved steves branch · 78cb1781
  Mohammad authored Apr 16, 2020
  
  78cb1781
- Merge branch 'staging_fix_task_main_imports' into 'staging' · c6b5c137
  Raul Puri authored Apr 16, 2020
```
Staging fix task main imports

See merge request ADLR/megatron-lm!62
```
  c6b5c137
- Better error reporting when a dataset doesn't exist. · f2779b18
  Jared Casper authored Apr 16, 2020
  
  f2779b18
- fixed tasks/main imports · 4d39aba4
  Mohammad authored Apr 16, 2020
  
  4d39aba4