Commits · 80f90dcdceb3c186111b412e311413c3bb6952e8 · OpenDAS / Megatron-LM

06 May, 2020 1 commit
- added parameters sharing · 80f90dcd
  Mohammad authored May 05, 2020
  
  80f90dcd
05 May, 2020 1 commit
- Update initialize.py · f931b8a3
  Raul Puri authored May 05, 2020
  
  f931b8a3
04 May, 2020 1 commit
- optionally allow no cpu · 6106127c
  Raul Puri authored May 03, 2020
  
  6106127c
27 Apr, 2020 1 commit
- remoed abbreviation matching from argparser · cf595489
  Mohammad authored Apr 27, 2020
  
  cf595489
24 Apr, 2020 5 commits
- fixed args · 04aa357e
  Mohammad authored Apr 24, 2020
  
  04aa357e
- flushed printing · 26c5f12a
  Raul Puri authored Apr 24, 2020
  
  26c5f12a
- addressed printing · 954f0725
  Raul Puri authored Apr 24, 2020
  
  954f0725
- changed default override behavior · d28527d5
  Raul Puri authored Apr 24, 2020
  
  d28527d5
- added case wordpiece arguments · ef5b2f06
  Raul Puri authored Apr 24, 2020
  
  ef5b2f06
21 Apr, 2020 5 commits
- removed optimized l2 grad clipping · 0b6bdca6
  Mohammad authored Apr 21, 2020
  
  0b6bdca6
- fixed a bug in l2 grad clip · 4ff2c963
  Mohammad authored Apr 20, 2020
  
  4ff2c963
- fixed a bug in l2 grad clip · fb5b2b36
  Mohammad authored Apr 20, 2020
  
  fb5b2b36
- removed bcast in local ddp · 41c1af0e
  Mohammad authored Apr 20, 2020
  
  41c1af0e
- added option to ignore unknown input arguments · 5531663b
  Mohammad authored Apr 20, 2020
  
  5531663b
16 Apr, 2020 5 commits
- changed licence 2019 to 2020 · 463d1257
  Mohammad authored Apr 16, 2020
  
  463d1257
- make minor modifications to licnese wording · 39af7956
  Mohammad authored Apr 16, 2020
  
  39af7956
- Better error reporting when a dataset doesn't exist. · f2779b18
  Jared Casper authored Apr 16, 2020
  
  f2779b18
- Check that the dataset helpers make runs successfully. · 9073c4bd
  Jared Casper authored Apr 16, 2020
  
  9073c4bd
- added runtime compilation for helpers · c6882114
  Mohammad authored Apr 15, 2020
  
  c6882114
15 Apr, 2020 8 commits
- addressed jareds comment · a4489ffb
  Mohammad authored Apr 15, 2020
  
  a4489ffb
- addressed jareds comments · b6e73188
  Mohammad authored Apr 15, 2020
  
  b6e73188
- added faster L2 grad clipping and new torch gelu · 3ea5491e
  Mohammad authored Apr 14, 2020
  
  3ea5491e
- added multi-tensor-apply to fp16 · 99410264
  Mohammad authored Apr 14, 2020
  
  99410264
- using None for resetting gradients · 3a701586
  Mohammad authored Apr 14, 2020
  
  3a701586
- addressed neels comments · 8e8e4548
  Mohammad authored Apr 14, 2020
  
  8e8e4548
- changed gpt2 masking to binary and masked_fill · 8ceed7c7
  Mohammad authored Apr 14, 2020
  
  8ceed7c7
- made size arguments optional so they can be set from input function · 368ad0d3
  Mohammad authored Apr 14, 2020
  
  368ad0d3
14 Apr, 2020 2 commits
- Lint whole repo · b7f1b050
  Neel Kant authored Apr 14, 2020
  
  b7f1b050
- added comment to build_index_mappings · d8bb57ad
  Mohammad authored Apr 13, 2020
  
  d8bb57ad
13 Apr, 2020 5 commits
- Do not cast data returned from indexed_dataset to int64, rely on caller to... · 71cf1866
  Jared Casper authored Apr 13, 2020
```
Do not cast data returned from indexed_dataset to int64, rely on caller to cast to appropriate type.
```
  71cf1866
- Add comment on purpose of test_indexed_dataset. · dff98d47
  Jared Casper authored Apr 13, 2020
  
  dff98d47
- refactored merge_mp_partitions.py · 03d0d93d
  Mohammad authored Apr 12, 2020
  
  03d0d93d
- some cleanup: configure data, requirements, and docker · 20764e12
  Mohammad authored Apr 12, 2020
  
  20764e12
- data loading for BERT and GPT cleaned up · 2e38461b
  Mohammad authored Apr 12, 2020
  
  2e38461b
12 Apr, 2020 1 commit
- fixed a bug related to last index in the shuffled_idx · eb74fa34
  Mohammad authored Apr 12, 2020
  
  eb74fa34
11 Apr, 2020 2 commits
- Update initialize.py · 87bd026a
  Raul Puri authored Apr 10, 2020
  
  87bd026a
- Added logic for initilialize_megatron to work with cpu only jobs. This is... · 5448ca25
  Raul Puri authored Apr 10, 2020
```
Added logic for initilialize_megatron to work with cpu only jobs. This is necessary for several evaluation and processing scripts in downstream repos.
```
  5448ca25
10 Apr, 2020 2 commits
- fp32 fixes · 5f174c07
  Mohammad authored Apr 10, 2020
  
  5f174c07
- addressed Jareds comments · 1c1a55da
  Mohammad authored Apr 09, 2020
  
  1c1a55da
09 Apr, 2020 1 commit
- moved current gpt2 dataloader to old · 898fcb94
  Mohammad authored Apr 08, 2020
  
  898fcb94