Commits · e9eef9628579e4ce946dadd7b84b14808183e72b · OpenDAS / Megatron-LM

08 May, 2020 1 commit
- Merge branch 'master_params_sharing' into 'master' · e9eef962
  Raul Puri authored May 08, 2020
```
Parameters sharing

See merge request ADLR/megatron-lm!82
```
  e9eef962
06 May, 2020 6 commits
- addressed jareds comment · c9c69c1e
  mohammad authored May 06, 2020
  
  c9c69c1e
- Merge branch 'master' into master_params_sharing · fe1ea898
  mohammad authored May 05, 2020
  
  fe1ea898
- tested and seems to be working · b1ac9fd3
  mohammad authored May 05, 2020
  
  b1ac9fd3
- Merge branch 'batch_sampler_update' into 'master' · 3ee811be
  Mohammad Shoeybi authored May 05, 2020
```
batch sampler interleave flag

See merge request ADLR/megatron-lm!81
```
  3ee811be
- added parameters sharing · f257d0ee
  Mohammad authored May 05, 2020
  
  f257d0ee
- added parameters sharing · 80f90dcd
  Mohammad authored May 05, 2020
  
  80f90dcd
05 May, 2020 4 commits
- more documentation for batch sampler · 5cb0c807
  Raul Puri authored May 05, 2020
  
  5cb0c807
- batch sampler interleave flag · 26d6aff4
  Raul Puri authored May 05, 2020
  
  26d6aff4
- Merge branch 'no_cpu_allowed' into 'master' · ad299490
  Mohammad Shoeybi authored May 05, 2020
```
optionally allow no cpu

See merge request ADLR/megatron-lm!80
```
  ad299490
- Update initialize.py · f931b8a3
  Raul Puri authored May 05, 2020
  
  f931b8a3
04 May, 2020 1 commit
- optionally allow no cpu · 6106127c
  Raul Puri authored May 03, 2020
  
  6106127c
28 Apr, 2020 2 commits
- Merge branch 'l2_grad_clip_fix_script' into 'master' · 569b3dab
  Mohammad Shoeybi authored Apr 27, 2020
```
updated the script

See merge request ADLR/megatron-lm!79
```
  569b3dab
- updated the script · 25234f8a
  Mostofa Patwary authored Apr 27, 2020
  
  25234f8a
27 Apr, 2020 2 commits
- Merge branch 'remove_arg_abv' into 'master' · f46d1c32
  Jared Casper authored Apr 27, 2020
```
remoed abbreviation matching from argparser

See merge request ADLR/megatron-lm!78
```
  f46d1c32
- remoed abbreviation matching from argparser · cf595489
  Mohammad authored Apr 27, 2020
  
  cf595489
24 Apr, 2020 7 commits
- Merge branch 'args_fix' into 'master' · 3262398d
  Raul Puri authored Apr 24, 2020
```
args bug fix

See merge request ADLR/megatron-lm!77
```
  3262398d
- fixed args · 04aa357e
  Mohammad authored Apr 24, 2020
  
  04aa357e
- Merge branch 'cased_update' into 'master' · 3af90c7a
  Mohammad Shoeybi authored Apr 24, 2020
```
added case wordpiece arguments

See merge request ADLR/megatron-lm!76
```
  3af90c7a
- flushed printing · 26c5f12a
  Raul Puri authored Apr 24, 2020
  
  26c5f12a
- addressed printing · 954f0725
  Raul Puri authored Apr 24, 2020
  
  954f0725
- changed default override behavior · d28527d5
  Raul Puri authored Apr 24, 2020
  
  d28527d5
- added case wordpiece arguments · ef5b2f06
  Raul Puri authored Apr 24, 2020
  
  ef5b2f06
21 Apr, 2020 12 commits
- Merge branch 'l2_grad_clip_fix' into 'master' · 03d28809
  Mostofa Patwary authored Apr 21, 2020
```
Reverting l2 grad optimization

See merge request ADLR/megatron-lm!74
```
  03d28809
- Merge branch 'master' into l2_grad_clip_fix · d218f9cf
  Mohammad authored Apr 21, 2020
  
  d218f9cf
- Merge branch 'remove_local_ddp_bcast' into 'master' · 3c709cba
  Raul Puri authored Apr 21, 2020
```
removed bcast from local ddp

See merge request ADLR/megatron-lm!72
```
  3c709cba
- removed optimized l2 grad clipping · 0b6bdca6
  Mohammad authored Apr 21, 2020
  
  0b6bdca6
- fixed a bug in l2 grad clip · 4ff2c963
  Mohammad authored Apr 20, 2020
  
  4ff2c963
- fixed a bug in l2 grad clip · fb5b2b36
  Mohammad authored Apr 20, 2020
  
  fb5b2b36
- Merge branch 'bert-vocab-chkpt' into 'master' · 73f73b81
  Mohammad Shoeybi authored Apr 20, 2020
```
Update README.md

See merge request ADLR/megatron-lm!73
```
  73f73b81
- Update README.md · 89462697
  Raul Puri authored Apr 20, 2020
  
  89462697
- Merge branch 'master' into remove_local_ddp_bcast · 97e07d64
  Mohammad authored Apr 20, 2020
  
  97e07d64
- Merge branch 'parse_known_args' into 'master' · eb0a8bf0
  Mohammad Shoeybi authored Apr 20, 2020
```
added option to ignore unknown input arguments

See merge request ADLR/megatron-lm!71
```
  eb0a8bf0
- removed bcast in local ddp · 41c1af0e
  Mohammad authored Apr 20, 2020
  
  41c1af0e
- added option to ignore unknown input arguments · 5531663b
  Mohammad authored Apr 20, 2020
  
  5531663b
20 Apr, 2020 4 commits
- Merge branch 'doc-vocab-links' into 'master' · d805e1a0
  Mohammad Shoeybi authored Apr 20, 2020
```
Doc vocab links

See merge request ADLR/megatron-lm!70
```
  d805e1a0
- Move links to download checkpoints section · b46e28bd
  Steven Steinke authored Apr 20, 2020
  
  b46e28bd
- Links to vocab in Data Preprocessing; added "WordPiece" to description · 8e4cb2a6
  Steven Steinke authored Apr 20, 2020
  
  8e4cb2a6
- Links to vocabs and merge table in Data Preprocessing · bdc3d5ba
  Steven Steinke authored Apr 20, 2020
  
  bdc3d5ba
16 Apr, 2020 1 commit
- Merge branch 'staging' into 'master' · 22c0e300
  Jared Casper authored Apr 16, 2020
```
April 2020 Release

See merge request ADLR/megatron-lm!69
```
  22c0e300