Commits · a0a58e97bed0c6f330cdfe1eefa6583cba9b764e · OpenDAS / Megatron-LM

07 Jul, 2021 1 commit

Getting rid of profiling and adding route for index (it sees the root of the... · a0a58e97

rprenger authored Jul 06, 2021

Getting rid of profiling and adding route for index (it sees the root of the project as the megatron subdirectory for some reason)

a0a58e97

02 Jul, 2021 1 commit
- Got 530 Billion parameter model working! · ac3db159
  rprenger authored Jul 02, 2021
  
  ac3db159
30 Jun, 2021 3 commits
- Removing unnecessary --recompute path · 453414da
  rprenger authored Jun 30, 2021
  
  453414da
- Clean up removing a lot of code. Works with curl people might still want a webpage or CLI · f7fe3865
  rprenger authored Jun 30, 2021
  
  f7fe3865
- Simpler broadcasting and some clean up · a9a3ef50
  rprenger authored Jun 30, 2021
  
  a9a3ef50
23 Jun, 2021 2 commits
- Also saving the launch script · 5580d661
  rprenger authored Jun 23, 2021
  
  5580d661
- Working single sentence version · 2cdebf4b
  rprenger authored Jun 23, 2021
  
  2cdebf4b
01 Jun, 2021 2 commits
- Merge branch 'main_retriver_merge_dpr' into 'main' · 83c4d95a
  Jared Casper authored Jun 01, 2021
```
Finetuning retriever (ICT+DPR)

See merge request ADLR/megatron-lm!277
```
  83c4d95a
- Merge branch 'vit_pipeline_fixes' into 'main' · 01fc0833
  Jared Casper authored Jun 01, 2021
```
vit pipeline fixes

See merge request ADLR/megatron-lm!276
```
  01fc0833
25 May, 2021 1 commit
- updating no load rng · fda81a21
  Mostofa Patwary authored May 25, 2021
  
  fda81a21
20 May, 2021 2 commits
- updating the scripts · 63121a9e
  Mostofa Patwary authored May 19, 2021
  
  63121a9e
- added exit interval for finetuning · d078e54a
  Mostofa Patwary authored May 19, 2021
  
  d078e54a
19 May, 2021 9 commits
- Merge branch 'finetune_assert' into 'main' · 217f54b3
  Mohammad Shoeybi authored May 19, 2021
```
Add temporary assert to finetuning until it can be fixed.

See merge request ADLR/megatron-lm!278
```
  217f54b3
- updated the evaluation script for retriver · 825375cf
  Mostofa Patwary authored May 18, 2021
  
  825375cf
- updated the evaluation script for retriver · a41e4781
  Mostofa Patwary authored May 18, 2021
  
  a41e4781
- updated the evaluation script for retriver · f21a6628
  Mostofa Patwary authored May 18, 2021
  
  f21a6628
- updated the evaluation script for retriver · dfb6a9b3
  Mostofa Patwary authored May 18, 2021
  
  dfb6a9b3
- Fixed issues with ICT pretraining · 7577931b
  Mostofa Patwary authored May 18, 2021
  
  7577931b
- Add temporary assert to finetuning until it can be fixed. · 113c6362
  Jared Casper authored May 18, 2021
  
  113c6362
- renaming the folders · 8e44d619
  Mostofa Patwary authored May 18, 2021
  
  8e44d619
- additional cleaning · 25293807
  Mostofa Patwary authored May 18, 2021
  
  25293807
18 May, 2021 4 commits
- cleaning the code · 2eaf6c79
  Mostofa Patwary authored May 18, 2021
  
  2eaf6c79
- vit pipeline fixes · ccae9dbd
  Vijay Korthikanti authored May 18, 2021
  
  ccae9dbd
- before cleaning the comments · 7a0710ec
  Mostofa Patwary authored May 18, 2021
  
  7a0710ec
- Merge branch 'main' into main_retriver_merge_dpr · 4a09bb3c
  Mostofa Patwary authored May 18, 2021
  
  4a09bb3c
15 May, 2021 4 commits
- Merge branch 'github-main' into 'main' · 42c1cf42
  Jared Casper authored May 15, 2021
```
Bringing github main and internal main back together.

See merge request ADLR/megatron-lm!275
```
  42c1cf42
- Merge internal main and github main back into one branch. · 5d65de54
  Jared Casper authored May 14, 2021
  
  5d65de54
- Merge branch 'readme_fix' into 'main' · 27b6c876
  Jared Casper authored May 15, 2021
```
One more quick fix.

See merge request ADLR/megatron-lm!274
```
  27b6c876
- One more quick fix. · 657d7cdc
  Jared Casper authored May 14, 2021
  
  657d7cdc
14 May, 2021 11 commits
- Merge branch 'readme_fix' into 'main' · 3f38ecf1
  Jared Casper authored May 14, 2021
```
Quick fix of copy/paste error.

See merge request ADLR/megatron-lm!273
```
  3f38ecf1
- Quick fix of copy/paste error. · edb76abe
  Jared Casper authored May 14, 2021
  
  edb76abe
- Merge branch 'preprocess_fix' into 'main' · bba90f79
  Mohammad Shoeybi authored May 14, 2021
```
Add arg needed for tokenizer.

See merge request ADLR/megatron-lm!272
```
  bba90f79
- Add arg needed for tokenizer. · 2c247afb
  Jared Casper authored May 14, 2021
  
  2c247afb
- Merge branch 'numpy_seed' into 'main' · 37475717
  Jared Casper authored May 14, 2021
```
Ensure numpy random seed is within range.

See merge request ADLR/megatron-lm!271
```
  37475717
- Ensure numpy random seed is within range. · 1c4c360f
  Jared Casper authored May 14, 2021
  
  1c4c360f
- Merge branch 'arg_checks' into 'main' · 002cde6b
  Mohammad Shoeybi authored May 14, 2021
```
Update arguments checks.

See merge request ADLR/megatron-lm!270
```
  002cde6b
- Merge branch 't5_docs' into 'main' · 78bad983
  Jared Casper authored May 14, 2021
```
Adding T5 to docs and a bit of cleanup.

See merge request ADLR/megatron-lm!269
```
  78bad983
- Adding T5 to docs and a bit of cleanup. · 306eb24e
  Jared Casper authored May 14, 2021
  
  306eb24e
- Update arguments checks. · 8044c7b4
  Jared Casper authored May 14, 2021
```
hidden_size % attention_heads == 0 is handled above when dealing with kv_channels.

Adding check for decoder sequence length.
```
  8044c7b4
- Merge branch 'v0_checkpoint_fixes' into 'main' · ee76a501
  Jared Casper authored May 14, 2021
```
fixed compatiblity with v0 checkpoints

See merge request ADLR/megatron-lm!268
```
  ee76a501