Commits · f7fe3865eb98ef96f43e3cfca412da5e902e263f · OpenDAS / Megatron-LM

30 Jun, 2021 2 commits
- Clean up removing a lot of code. Works with curl people might still want a webpage or CLI · f7fe3865
  rprenger authored Jun 30, 2021
  
  f7fe3865
- Simpler broadcasting and some clean up · a9a3ef50
  rprenger authored Jun 30, 2021
  
  a9a3ef50
23 Jun, 2021 2 commits
- Also saving the launch script · 5580d661
  rprenger authored Jun 23, 2021
  
  5580d661
- Working single sentence version · 2cdebf4b
  rprenger authored Jun 23, 2021
  
  2cdebf4b
01 Jun, 2021 2 commits
- Merge branch 'main_retriver_merge_dpr' into 'main' · 83c4d95a
  Jared Casper authored Jun 01, 2021
```
Finetuning retriever (ICT+DPR)

See merge request ADLR/megatron-lm!277
```
  83c4d95a
- Merge branch 'vit_pipeline_fixes' into 'main' · 01fc0833
  Jared Casper authored Jun 01, 2021
```
vit pipeline fixes

See merge request ADLR/megatron-lm!276
```
  01fc0833
25 May, 2021 1 commit
- updating no load rng · fda81a21
  Mostofa Patwary authored May 25, 2021
  
  fda81a21
20 May, 2021 2 commits
- updating the scripts · 63121a9e
  Mostofa Patwary authored May 19, 2021
  
  63121a9e
- added exit interval for finetuning · d078e54a
  Mostofa Patwary authored May 19, 2021
  
  d078e54a
19 May, 2021 9 commits
- Merge branch 'finetune_assert' into 'main' · 217f54b3
  Mohammad Shoeybi authored May 19, 2021
```
Add temporary assert to finetuning until it can be fixed.

See merge request ADLR/megatron-lm!278
```
  217f54b3
- updated the evaluation script for retriver · 825375cf
  Mostofa Patwary authored May 18, 2021
  
  825375cf
- updated the evaluation script for retriver · a41e4781
  Mostofa Patwary authored May 18, 2021
  
  a41e4781
- updated the evaluation script for retriver · f21a6628
  Mostofa Patwary authored May 18, 2021
  
  f21a6628
- updated the evaluation script for retriver · dfb6a9b3
  Mostofa Patwary authored May 18, 2021
  
  dfb6a9b3
- Fixed issues with ICT pretraining · 7577931b
  Mostofa Patwary authored May 18, 2021
  
  7577931b
- Add temporary assert to finetuning until it can be fixed. · 113c6362
  Jared Casper authored May 18, 2021
  
  113c6362
- renaming the folders · 8e44d619
  Mostofa Patwary authored May 18, 2021
  
  8e44d619
- additional cleaning · 25293807
  Mostofa Patwary authored May 18, 2021
  
  25293807
18 May, 2021 4 commits
- cleaning the code · 2eaf6c79
  Mostofa Patwary authored May 18, 2021
  
  2eaf6c79
- vit pipeline fixes · ccae9dbd
  Vijay Korthikanti authored May 18, 2021
  
  ccae9dbd
- before cleaning the comments · 7a0710ec
  Mostofa Patwary authored May 18, 2021
  
  7a0710ec
- Merge branch 'main' into main_retriver_merge_dpr · 4a09bb3c
  Mostofa Patwary authored May 18, 2021
  
  4a09bb3c
15 May, 2021 4 commits
- Merge branch 'github-main' into 'main' · 42c1cf42
  Jared Casper authored May 15, 2021
```
Bringing github main and internal main back together.

See merge request ADLR/megatron-lm!275
```
  42c1cf42
- Merge internal main and github main back into one branch. · 5d65de54
  Jared Casper authored May 14, 2021
  
  5d65de54
- Merge branch 'readme_fix' into 'main' · 27b6c876
  Jared Casper authored May 15, 2021
```
One more quick fix.

See merge request ADLR/megatron-lm!274
```
  27b6c876
- One more quick fix. · 657d7cdc
  Jared Casper authored May 14, 2021
  
  657d7cdc
14 May, 2021 13 commits
- Merge branch 'readme_fix' into 'main' · 3f38ecf1
  Jared Casper authored May 14, 2021
```
Quick fix of copy/paste error.

See merge request ADLR/megatron-lm!273
```
  3f38ecf1
- Quick fix of copy/paste error. · edb76abe
  Jared Casper authored May 14, 2021
  
  edb76abe
- Merge branch 'preprocess_fix' into 'main' · bba90f79
  Mohammad Shoeybi authored May 14, 2021
```
Add arg needed for tokenizer.

See merge request ADLR/megatron-lm!272
```
  bba90f79
- Add arg needed for tokenizer. · 2c247afb
  Jared Casper authored May 14, 2021
  
  2c247afb
- Merge branch 'numpy_seed' into 'main' · 37475717
  Jared Casper authored May 14, 2021
```
Ensure numpy random seed is within range.

See merge request ADLR/megatron-lm!271
```
  37475717
- Ensure numpy random seed is within range. · 1c4c360f
  Jared Casper authored May 14, 2021
  
  1c4c360f
- Merge branch 'arg_checks' into 'main' · 002cde6b
  Mohammad Shoeybi authored May 14, 2021
```
Update arguments checks.

See merge request ADLR/megatron-lm!270
```
  002cde6b
- Merge branch 't5_docs' into 'main' · 78bad983
  Jared Casper authored May 14, 2021
```
Adding T5 to docs and a bit of cleanup.

See merge request ADLR/megatron-lm!269
```
  78bad983
- Adding T5 to docs and a bit of cleanup. · 306eb24e
  Jared Casper authored May 14, 2021
  
  306eb24e
- Update arguments checks. · 8044c7b4
  Jared Casper authored May 14, 2021
```
hidden_size % attention_heads == 0 is handled above when dealing with kv_channels.

Adding check for decoder sequence length.
```
  8044c7b4
- Merge branch 'v0_checkpoint_fixes' into 'main' · ee76a501
  Jared Casper authored May 14, 2021
```
fixed compatiblity with v0 checkpoints

See merge request ADLR/megatron-lm!268
```
  ee76a501
- fixed compatiblity with v0 checkpoints · 26b49aab
  mohammad authored May 14, 2021
  
  26b49aab
- debugging DPR · dca47cfb
  Mostofa Patwary authored May 14, 2021
  
  dca47cfb
13 May, 2021 1 commit
- evaluation works! · f64977fd
  Mostofa Patwary authored May 13, 2021
  
  f64977fd