Commits · 01fc0833469f09cf6724b9868b70c48942fab754 · OpenDAS / Megatron-LM

01 Jun, 2021 1 commit
- Merge branch 'vit_pipeline_fixes' into 'main' · 01fc0833
  Jared Casper authored Jun 01, 2021
```
vit pipeline fixes

See merge request ADLR/megatron-lm!276
```
  01fc0833
19 May, 2021 2 commits
- Merge branch 'finetune_assert' into 'main' · 217f54b3
  Mohammad Shoeybi authored May 19, 2021
```
Add temporary assert to finetuning until it can be fixed.

See merge request ADLR/megatron-lm!278
```
  217f54b3
- Add temporary assert to finetuning until it can be fixed. · 113c6362
  Jared Casper authored May 18, 2021
  
  113c6362
18 May, 2021 1 commit
- vit pipeline fixes · ccae9dbd
  Vijay Korthikanti authored May 18, 2021
  
  ccae9dbd
15 May, 2021 4 commits
- Merge branch 'github-main' into 'main' · 42c1cf42
  Jared Casper authored May 15, 2021
```
Bringing github main and internal main back together.

See merge request ADLR/megatron-lm!275
```
  42c1cf42
- Merge internal main and github main back into one branch. · 5d65de54
  Jared Casper authored May 14, 2021
  
  5d65de54
- Merge branch 'readme_fix' into 'main' · 27b6c876
  Jared Casper authored May 15, 2021
```
One more quick fix.

See merge request ADLR/megatron-lm!274
```
  27b6c876
- One more quick fix. · 657d7cdc
  Jared Casper authored May 14, 2021
  
  657d7cdc
14 May, 2021 12 commits
- Merge branch 'readme_fix' into 'main' · 3f38ecf1
  Jared Casper authored May 14, 2021
```
Quick fix of copy/paste error.

See merge request ADLR/megatron-lm!273
```
  3f38ecf1
- Quick fix of copy/paste error. · edb76abe
  Jared Casper authored May 14, 2021
  
  edb76abe
- Merge branch 'preprocess_fix' into 'main' · bba90f79
  Mohammad Shoeybi authored May 14, 2021
```
Add arg needed for tokenizer.

See merge request ADLR/megatron-lm!272
```
  bba90f79
- Add arg needed for tokenizer. · 2c247afb
  Jared Casper authored May 14, 2021
  
  2c247afb
- Merge branch 'numpy_seed' into 'main' · 37475717
  Jared Casper authored May 14, 2021
```
Ensure numpy random seed is within range.

See merge request ADLR/megatron-lm!271
```
  37475717
- Ensure numpy random seed is within range. · 1c4c360f
  Jared Casper authored May 14, 2021
  
  1c4c360f
- Merge branch 'arg_checks' into 'main' · 002cde6b
  Mohammad Shoeybi authored May 14, 2021
```
Update arguments checks.

See merge request ADLR/megatron-lm!270
```
  002cde6b
- Merge branch 't5_docs' into 'main' · 78bad983
  Jared Casper authored May 14, 2021
```
Adding T5 to docs and a bit of cleanup.

See merge request ADLR/megatron-lm!269
```
  78bad983
- Adding T5 to docs and a bit of cleanup. · 306eb24e
  Jared Casper authored May 14, 2021
  
  306eb24e
- Update arguments checks. · 8044c7b4
  Jared Casper authored May 14, 2021
```
hidden_size % attention_heads == 0 is handled above when dealing with kv_channels.

Adding check for decoder sequence length.
```
  8044c7b4
- Merge branch 'v0_checkpoint_fixes' into 'main' · ee76a501
  Jared Casper authored May 14, 2021
```
fixed compatiblity with v0 checkpoints

See merge request ADLR/megatron-lm!268
```
  ee76a501
- fixed compatiblity with v0 checkpoints · 26b49aab
  mohammad authored May 14, 2021
  
  26b49aab
22 Apr, 2021 3 commits
- Merge branch 't5_merge' into 'main' · 2ff004ac
  Mohammad Shoeybi authored Apr 22, 2021
```
Integrate code from t5_main into existing code.

See merge request ADLR/megatron-lm!261
```
  2ff004ac
- Merge branch 'main_generate' into 'main' · 716a3243
  Jared Casper authored Apr 22, 2021
```
lm evaluation

See merge request ADLR/megatron-lm!262
```
  716a3243
- Merge branch 'main_dedup' into 'main' · 7a5768ac
  Jared Casper authored Apr 22, 2021
```
Training data and task deduplication

See merge request ADLR/megatron-lm!252
```
  7a5768ac
21 Apr, 2021 4 commits
- addressed comments · e5ec27d7
  Mostofa Patwary authored Apr 21, 2021
  
  e5ec27d7
- addressed comments · 5a6431f5
  Mostofa Patwary authored Apr 21, 2021
  
  5a6431f5
- addressed comments · 5c2ce593
  Mostofa Patwary authored Apr 21, 2021
  
  5c2ce593
- addressed reviews · 0fa728ac
  Mostofa Patwary authored Apr 21, 2021
  
  0fa728ac
20 Apr, 2021 3 commits
- added more comments · f938e19a
  Mostofa Patwary authored Apr 20, 2021
  
  f938e19a
- added more comments · c49b4644
  Mostofa Patwary authored Apr 20, 2021
  
  c49b4644
- Merge branch 'main' into main_dedup · 7c3d8b7a
  Mostofa Patwary authored Apr 20, 2021
  
  7c3d8b7a
19 Apr, 2021 1 commit
- modified the params · 44bfcb32
  Mostofa Patwary authored Apr 19, 2021
  
  44bfcb32
16 Apr, 2021 2 commits
- added this function for evaluation · 045959cb
  Mostofa Patwary authored Apr 16, 2021
  
  045959cb
- Integrate code from t5_main into existing code. · 48a5e0da
  Jared Casper authored Apr 15, 2021
  
  48a5e0da
12 Apr, 2021 3 commits
- Merge branch 'main' into github-main · aed2f75e
  Jared Casper authored Apr 11, 2021
  
  aed2f75e
- Merge branch 'add_ref' into 'main' · f32a638d
  Jared Casper authored Apr 12, 2021
```
added link to the pipeline paper

See merge request ADLR/megatron-lm!259
```
  f32a638d
- added link to the pipeline papers · 9ec547c9
  mohammad authored Apr 11, 2021
  
  9ec547c9
08 Apr, 2021 2 commits
- Merge branch 'release_fixes' into 'main' · 8cfef1bf
  Deepak Narayanan authored Apr 08, 2021
```
Release fixes

See merge request ADLR/megatron-lm!258
```
  8cfef1bf
- Release fixes · 50a4b5fa
  Mohammad Shoeybi authored Apr 08, 2021
  
  50a4b5fa
03 Apr, 2021 2 commits
- Merge branch 'interleaved_bugfix' into 'main' · 23632ee5
  Mohammad Shoeybi authored Apr 03, 2021
```
Small bugfix to make sure refactored code works with interleaved schedule

See merge request ADLR/megatron-lm!256
```
  23632ee5
- Small bugfix to make sure refactored code works with interleaved schedule · 6fd78189
  Deepak Narayanan authored Apr 03, 2021
  
  6fd78189