Commits · ac837a4e77aa976ce3b5ab0b6ec5ef2b06dfa896 · OpenDAS / Megatron-LM

18 Nov, 2020 7 commits
- Merge branch 'community-fixes' into 'main' · ac837a4e
  Mohammad Shoeybi authored Nov 17, 2020
```
Community fixes

See merge request ADLR/megatron-lm!176
```
  ac837a4e
- Merge branch 'fix/help-title-dist' of https://github.com/lazykyama/Megatron-LM into community-fixes · 356f8771
  Jared Casper authored Nov 17, 2020
  
  356f8771
- Merge branch 'patch-1' of https://github.com/sublee/Megatron-LM into community-fixes · 24ccd8aa
  Jared Casper authored Nov 17, 2020
  
  24ccd8aa
- Merge branch 'patch-2' of https://github.com/nakosung/Megatron-LM into community-fixes · cec3dbe6
  Jared Casper authored Nov 17, 2020
  
  cec3dbe6
- Merge branch 'patch-1' of https://github.com/nakosung/Megatron-LM into community-fixes · 8d0da202
  Jared Casper authored Nov 17, 2020
  
  8d0da202
- Merge branch 'patch-1' of https://github.com/dweekly/Megatron-LM into community-fixes · 5e934043
  Jared Casper authored Nov 17, 2020
  
  5e934043
- Merge branch 'patch-1' of https://github.com/akhileshgotmare/Megatron-LM into community-fixes · 642c644a
  Jared Casper authored Nov 17, 2020
  
  642c644a
17 Nov, 2020 2 commits
- Merge branch 'finetune_fix' into 'main' · e7c7a78f
  Mohammad Shoeybi authored Nov 16, 2020
```
Update code used for finetuning to latest API.

See merge request ADLR/megatron-lm!174
```
  e7c7a78f
- Update code used for finetuning to latest API. · b219ff00
  Jared Casper authored Nov 16, 2020
  
  b219ff00
03 Nov, 2020 2 commits
- Merge branch 'fix_logging' into 'main' · b4b0d739
  Deepak Narayanan authored Nov 03, 2020
```
fixed loss average when all but one value is skipped

See merge request ADLR/megatron-lm!164
```
  b4b0d739
- fixed loss average when all but one value is skipped · 664cd28b
  mohammad authored Nov 03, 2020
  
  664cd28b
20 Oct, 2020 1 commit
- Change distributed argument group title to appropriate one. · c147a3e8
  Kazuhiro Yamasaki authored Oct 20, 2020
  
  c147a3e8
14 Oct, 2020 6 commits
- Merge branch 'main_evaluate_wiki' into 'main' · 79888e16
  Mohammad Shoeybi authored Oct 14, 2020
```
fixed wiki evaluation

See merge request ADLR/megatron-lm!157
```
  79888e16
- fixed wiki evaluation issue · ef2adb5d
  Mostofa Patwary authored Oct 14, 2020
  
  ef2adb5d
- fixed wiki evaluation issue · 38c45de7
  Mostofa Patwary authored Oct 14, 2020
  
  38c45de7
- Merge branch 'main_beta' into 'main' · 64cf3d98
  Mohammad Shoeybi authored Oct 13, 2020
```
Adam betas and eps

See merge request ADLR/megatron-lm!156
```
  64cf3d98
- added adam betas and eps as arguments · c55e154f
  Mostofa Patwary authored Oct 13, 2020
  
  c55e154f
- added adam betas and eps as arguments · 48269d8d
  Mostofa Patwary authored Oct 13, 2020
  
  48269d8d
13 Oct, 2020 5 commits
- Merge branch 'vijay/suppress_ninja_output' into 'main' · 5753e8f1
  Mohammad Shoeybi authored Oct 12, 2020
```
suppress kernel loading output

See merge request ADLR/megatron-lm!155
```
  5753e8f1
- suppress kernel loading output · 8fca9b49
  Vijay Korthikanti authored Oct 12, 2020
  
  8fca9b49
- Merge branch 'vijay/ordering_perf_fix' into 'main' · 538f0e05
  Mohammad Shoeybi authored Oct 12, 2020
```
reordering perf fix

See merge request ADLR/megatron-lm!154
```
  538f0e05
- typo fix · 01dffdb5
  Vijay Korthikanti authored Oct 12, 2020
  
  01dffdb5
- address review comments · 0bc75448
  Vijay Korthikanti authored Oct 12, 2020
  
  0bc75448
12 Oct, 2020 2 commits
- Incrementing checkpoint version to 2.0 · 9b0083ea
  Vijay Korthikanti authored Oct 12, 2020
  
  9b0083ea
- reordering perf fix · ee327acd
  Vijay Korthikanti authored Oct 12, 2020
  
  ee327acd
09 Oct, 2020 3 commits
- Merge branch 'build_fix' into 'main' · 42d21122
  Mohammad Shoeybi authored Oct 09, 2020
```
Create build directory for fused_kernels before building.

See merge request ADLR/megatron-lm!149
```
  42d21122
- Merge branch 'vijay/diff_query_key_lengths' into 'main' · 54282071
  Mohammad Shoeybi authored Oct 08, 2020
```
support for different query key sequence lengths

See merge request ADLR/megatron-lm!151
```
  54282071
- support for different query key sequence lengths · d763f54a
  Vijay Korthikanti authored Oct 08, 2020
  
  d763f54a
08 Oct, 2020 2 commits
- Escape % in --split help message · e629f36e
  Heungsub Lee authored Oct 09, 2020
  
  e629f36e
- Create build directory for fused_kernels before building. · 54ded172
  Jared Casper authored Oct 07, 2020
  
  54ded172
06 Oct, 2020 2 commits
- Merge branch 'vijay/fused_kernel_compiliation' into 'main' · 56e16cba
  Jared Casper authored Oct 05, 2020
```
Avoid non deterministic arch order in compilation

See merge request ADLR/megatron-lm!146
```
  56e16cba
- build directory · 3dcd7dc0
  Vijay Korthikanti authored Oct 05, 2020
  
  3dcd7dc0
05 Oct, 2020 2 commits
- build_directory argument · a7f4e460
  Vijay Korthikanti authored Oct 05, 2020
  
  a7f4e460
- avoid non deterministic arch order in compilation · 37d77ca0
  Vijay Korthikanti authored Oct 05, 2020
  
  37d77ca0
02 Oct, 2020 5 commits
- Merge branch 'pip_1.1.5' into 'main' · d80433e1
  Mohammad Shoeybi authored Oct 02, 2020
```
pip 1.1.5

See merge request ADLR/megatron-lm!144
```
  d80433e1
- pip 1.1.5 · f9387ec3
  Evelina authored Oct 02, 2020
```
Signed-off-by: Evelina <ebakhturina@nvidia.com>
```
  f9387ec3
- Merge branch 'pip_1.1.4' into 'main' · b7dac89a
  Mohammad Shoeybi authored Oct 01, 2020
```
1.1.4. pip version

See merge request ADLR/megatron-lm!120
```
  b7dac89a
- Merge branch 'mpatwary/main_text_gen' into 'main' · b1870045
  Mohammad Shoeybi authored Oct 01, 2020
```
Fixed uninit communication gruop

See merge request ADLR/megatron-lm!142
```
  b1870045
- Fixed uninit communication gruop · 057a1fab
  Mostofa Patwary authored Oct 01, 2020
  
  057a1fab
01 Oct, 2020 1 commit

Merge branch 'check_mpu_init' into 'main' · 10c828ed

Jared Casper authored Oct 01, 2020

fix for nemo: do not initialize mpu if it is already initialized

See merge request ADLR/megatron-lm!141

10c828ed