Commits · 46a536cc888dcd4899c3f74d048ec29b9d93a412 · OpenDAS / Megatron-LM

11 Jun, 2020 1 commit
- Merge branch 'mmap_data_samples' into 'master' · 46a536cc
  Mohammad Shoeybi authored Jun 10, 2020
```
mmap sample map

See merge request ADLR/megatron-lm!88
```
  46a536cc
10 Jun, 2020 2 commits
- gpt2 mmap sample map · dd76c914
  Raul Puri authored Jun 10, 2020
  
  dd76c914
- mmap sample map · 2b47c5e7
  Raul Puri authored Jun 10, 2020
  
  2b47c5e7
05 Jun, 2020 6 commits
- Merge branch 'cross_entropy_mem_opt' into 'master' · cfe35fd3
  Jared Casper authored Jun 05, 2020
```
Option to perform language model cross entropy calculations in fp16

See merge request ADLR/megatron-lm!86
```
  cfe35fd3
- addressed jareds comments · 197c132e
  mohammad authored Jun 05, 2020
  
  197c132e
- added fp16 lm cross entropy to bert · 78022005
  mohammad authored Jun 05, 2020
  
  78022005
- added fp16 cross entropy loss option for gpt2 · 22e3c7e6
  mohammad authored Jun 05, 2020
  
  22e3c7e6
- added fp16 cross entropy loss option for gpt2 · acfe848e
  mohammad authored Jun 05, 2020
  
  acfe848e
- testing · 2ede8235
  mohammad authored Jun 05, 2020
  
  2ede8235
15 May, 2020 2 commits
- Merge branch 'pip_support' into 'master' · 5897a790
  Mohammad Shoeybi authored May 14, 2020
```
pip_supports

See merge request ADLR/megatron-lm!75
```
  5897a790
- update · faa462fa
  Evelina Bakhturina authored May 14, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  faa462fa
14 May, 2020 11 commits
- update · 5f871088
  Evelina Bakhturina authored May 14, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  5f871088
- update · 14fac298
  Evelina Bakhturina authored May 14, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  14fac298
- license · eb641b07
  Evelina Bakhturina authored May 14, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  eb641b07
- update · 1f39e69b
  Evelina Bakhturina authored May 14, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  1f39e69b
- update2 · 73fef4fc
  Evelina Bakhturina authored May 14, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  73fef4fc
- update · c60fb37e
  Evelina Bakhturina authored May 14, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  c60fb37e
- six, regex, apex added to requirements · c15829b5
  Evelina Bakhturina authored May 14, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  c15829b5
- helpers.cpp suupport added, version changed, clean up · dd483295
  Evelina Bakhturina authored Apr 28, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  dd483295
- review feedback · cd3529b9
  Evelina Bakhturina authored Apr 21, 2020
  
  cd3529b9
- clean up · 71f9e76c
  Evelina Bakhturina authored Apr 21, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  71f9e76c
- pip support added · bf1daf86
  Evelina Bakhturina authored Apr 21, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  bf1daf86
08 May, 2020 1 commit
- Merge branch 'master_params_sharing' into 'master' · e9eef962
  Raul Puri authored May 08, 2020
```
Parameters sharing

See merge request ADLR/megatron-lm!82
```
  e9eef962
06 May, 2020 6 commits
- addressed jareds comment · c9c69c1e
  mohammad authored May 06, 2020
  
  c9c69c1e
- Merge branch 'master' into master_params_sharing · fe1ea898
  mohammad authored May 05, 2020
  
  fe1ea898
- tested and seems to be working · b1ac9fd3
  mohammad authored May 05, 2020
  
  b1ac9fd3
- Merge branch 'batch_sampler_update' into 'master' · 3ee811be
  Mohammad Shoeybi authored May 05, 2020
```
batch sampler interleave flag

See merge request ADLR/megatron-lm!81
```
  3ee811be
- added parameters sharing · f257d0ee
  Mohammad authored May 05, 2020
  
  f257d0ee
- added parameters sharing · 80f90dcd
  Mohammad authored May 05, 2020
  
  80f90dcd
05 May, 2020 4 commits
- more documentation for batch sampler · 5cb0c807
  Raul Puri authored May 05, 2020
  
  5cb0c807
- batch sampler interleave flag · 26d6aff4
  Raul Puri authored May 05, 2020
  
  26d6aff4
- Merge branch 'no_cpu_allowed' into 'master' · ad299490
  Mohammad Shoeybi authored May 05, 2020
```
optionally allow no cpu

See merge request ADLR/megatron-lm!80
```
  ad299490
- Update initialize.py · f931b8a3
  Raul Puri authored May 05, 2020
  
  f931b8a3
04 May, 2020 1 commit
- optionally allow no cpu · 6106127c
  Raul Puri authored May 03, 2020
  
  6106127c
28 Apr, 2020 2 commits
- Merge branch 'l2_grad_clip_fix_script' into 'master' · 569b3dab
  Mohammad Shoeybi authored Apr 27, 2020
```
updated the script

See merge request ADLR/megatron-lm!79
```
  569b3dab
- updated the script · 25234f8a
  Mostofa Patwary authored Apr 27, 2020
  
  25234f8a
27 Apr, 2020 2 commits
- Merge branch 'remove_arg_abv' into 'master' · f46d1c32
  Jared Casper authored Apr 27, 2020
```
remoed abbreviation matching from argparser

See merge request ADLR/megatron-lm!78
```
  f46d1c32
- remoed abbreviation matching from argparser · cf595489
  Mohammad authored Apr 27, 2020
  
  cf595489
24 Apr, 2020 2 commits
- Merge branch 'args_fix' into 'master' · 3262398d
  Raul Puri authored Apr 24, 2020
```
args bug fix

See merge request ADLR/megatron-lm!77
```
  3262398d
- fixed args · 04aa357e
  Mohammad authored Apr 24, 2020
  
  04aa357e