Commits · d562d7b5fddb7bf7e6140d35d05b2b4ea331f6e0 · OpenDAS / Megatron-LM

10 Jun, 2021 3 commits
- Adding readme · d562d7b5
  Mostofa Patwary authored Jun 09, 2021
  
  d562d7b5
- Adding readme · a983cab3
  Mostofa Patwary authored Jun 09, 2021
  
  a983cab3
- fixed the evaluation hangs · e46f3260
  Mostofa Patwary authored Jun 09, 2021
  
  e46f3260
09 Jun, 2021 1 commit
- fixed the tensor size miss-mass issue · ebfbfcec
  Mostofa Patwary authored Jun 09, 2021
  
  ebfbfcec
08 Jun, 2021 1 commit
- resolved hang issue · 04c79f30
  Mostofa Patwary authored Jun 08, 2021
  
  04c79f30
03 Jun, 2021 2 commits
- Merge branch 'main' into main_retriver_merge_dpr · 84eb016c
  Mostofa Patwary authored Jun 03, 2021
  
  84eb016c
- updating script · c7c65bbb
  Mostofa Patwary authored Jun 03, 2021
  
  c7c65bbb
01 Jun, 2021 2 commits
- Merge branch 'main_retriver_merge_dpr' into 'main' · 83c4d95a
  Jared Casper authored Jun 01, 2021
```
Finetuning retriever (ICT+DPR)

See merge request ADLR/megatron-lm!277
```
  83c4d95a
- Merge branch 'vit_pipeline_fixes' into 'main' · 01fc0833
  Jared Casper authored Jun 01, 2021
```
vit pipeline fixes

See merge request ADLR/megatron-lm!276
```
  01fc0833
25 May, 2021 1 commit
- updating no load rng · fda81a21
  Mostofa Patwary authored May 25, 2021
  
  fda81a21
20 May, 2021 2 commits
- updating the scripts · 63121a9e
  Mostofa Patwary authored May 19, 2021
  
  63121a9e
- added exit interval for finetuning · d078e54a
  Mostofa Patwary authored May 19, 2021
  
  d078e54a
19 May, 2021 9 commits
- Merge branch 'finetune_assert' into 'main' · 217f54b3
  Mohammad Shoeybi authored May 19, 2021
```
Add temporary assert to finetuning until it can be fixed.

See merge request ADLR/megatron-lm!278
```
  217f54b3
- updated the evaluation script for retriver · 825375cf
  Mostofa Patwary authored May 18, 2021
  
  825375cf
- updated the evaluation script for retriver · a41e4781
  Mostofa Patwary authored May 18, 2021
  
  a41e4781
- updated the evaluation script for retriver · f21a6628
  Mostofa Patwary authored May 18, 2021
  
  f21a6628
- updated the evaluation script for retriver · dfb6a9b3
  Mostofa Patwary authored May 18, 2021
  
  dfb6a9b3
- Fixed issues with ICT pretraining · 7577931b
  Mostofa Patwary authored May 18, 2021
  
  7577931b
- Add temporary assert to finetuning until it can be fixed. · 113c6362
  Jared Casper authored May 18, 2021
  
  113c6362
- renaming the folders · 8e44d619
  Mostofa Patwary authored May 18, 2021
  
  8e44d619
- additional cleaning · 25293807
  Mostofa Patwary authored May 18, 2021
  
  25293807
18 May, 2021 4 commits
- cleaning the code · 2eaf6c79
  Mostofa Patwary authored May 18, 2021
  
  2eaf6c79
- vit pipeline fixes · ccae9dbd
  Vijay Korthikanti authored May 18, 2021
  
  ccae9dbd
- before cleaning the comments · 7a0710ec
  Mostofa Patwary authored May 18, 2021
  
  7a0710ec
- Merge branch 'main' into main_retriver_merge_dpr · 4a09bb3c
  Mostofa Patwary authored May 18, 2021
  
  4a09bb3c
15 May, 2021 4 commits
- Merge branch 'github-main' into 'main' · 42c1cf42
  Jared Casper authored May 15, 2021
```
Bringing github main and internal main back together.

See merge request ADLR/megatron-lm!275
```
  42c1cf42
- Merge internal main and github main back into one branch. · 5d65de54
  Jared Casper authored May 14, 2021
  
  5d65de54
- Merge branch 'readme_fix' into 'main' · 27b6c876
  Jared Casper authored May 15, 2021
```
One more quick fix.

See merge request ADLR/megatron-lm!274
```
  27b6c876
- One more quick fix. · 657d7cdc
  Jared Casper authored May 14, 2021
  
  657d7cdc
14 May, 2021 11 commits
- Merge branch 'readme_fix' into 'main' · 3f38ecf1
  Jared Casper authored May 14, 2021
```
Quick fix of copy/paste error.

See merge request ADLR/megatron-lm!273
```
  3f38ecf1
- Quick fix of copy/paste error. · edb76abe
  Jared Casper authored May 14, 2021
  
  edb76abe
- Merge branch 'preprocess_fix' into 'main' · bba90f79
  Mohammad Shoeybi authored May 14, 2021
```
Add arg needed for tokenizer.

See merge request ADLR/megatron-lm!272
```
  bba90f79
- Add arg needed for tokenizer. · 2c247afb
  Jared Casper authored May 14, 2021
  
  2c247afb
- Merge branch 'numpy_seed' into 'main' · 37475717
  Jared Casper authored May 14, 2021
```
Ensure numpy random seed is within range.

See merge request ADLR/megatron-lm!271
```
  37475717
- Ensure numpy random seed is within range. · 1c4c360f
  Jared Casper authored May 14, 2021
  
  1c4c360f
- Merge branch 'arg_checks' into 'main' · 002cde6b
  Mohammad Shoeybi authored May 14, 2021
```
Update arguments checks.

See merge request ADLR/megatron-lm!270
```
  002cde6b
- Merge branch 't5_docs' into 'main' · 78bad983
  Jared Casper authored May 14, 2021
```
Adding T5 to docs and a bit of cleanup.

See merge request ADLR/megatron-lm!269
```
  78bad983
- Adding T5 to docs and a bit of cleanup. · 306eb24e
  Jared Casper authored May 14, 2021
  
  306eb24e
- Update arguments checks. · 8044c7b4
  Jared Casper authored May 14, 2021
```
hidden_size % attention_heads == 0 is handled above when dealing with kv_channels.

Adding check for decoder sequence length.
```
  8044c7b4
- Merge branch 'v0_checkpoint_fixes' into 'main' · ee76a501
  Jared Casper authored May 14, 2021
```
fixed compatiblity with v0 checkpoints

See merge request ADLR/megatron-lm!268
```
  ee76a501