Commits · 7577931bcee062ce6213f1147fbb034fb35c307c · OpenDAS / Megatron-LM

19 May, 2021 3 commits
- Fixed issues with ICT pretraining · 7577931b
  Mostofa Patwary authored May 18, 2021
  
  7577931b
- renaming the folders · 8e44d619
  Mostofa Patwary authored May 18, 2021
  
  8e44d619
- additional cleaning · 25293807
  Mostofa Patwary authored May 18, 2021
  
  25293807
18 May, 2021 3 commits
- cleaning the code · 2eaf6c79
  Mostofa Patwary authored May 18, 2021
  
  2eaf6c79
- before cleaning the comments · 7a0710ec
  Mostofa Patwary authored May 18, 2021
  
  7a0710ec
- Merge branch 'main' into main_retriver_merge_dpr · 4a09bb3c
  Mostofa Patwary authored May 18, 2021
  
  4a09bb3c
15 May, 2021 4 commits
- Merge branch 'github-main' into 'main' · 42c1cf42
  Jared Casper authored May 15, 2021
```
Bringing github main and internal main back together.

See merge request ADLR/megatron-lm!275
```
  42c1cf42
- Merge internal main and github main back into one branch. · 5d65de54
  Jared Casper authored May 14, 2021
  
  5d65de54
- Merge branch 'readme_fix' into 'main' · 27b6c876
  Jared Casper authored May 15, 2021
```
One more quick fix.

See merge request ADLR/megatron-lm!274
```
  27b6c876
- One more quick fix. · 657d7cdc
  Jared Casper authored May 14, 2021
  
  657d7cdc
14 May, 2021 13 commits
- Merge branch 'readme_fix' into 'main' · 3f38ecf1
  Jared Casper authored May 14, 2021
```
Quick fix of copy/paste error.

See merge request ADLR/megatron-lm!273
```
  3f38ecf1
- Quick fix of copy/paste error. · edb76abe
  Jared Casper authored May 14, 2021
  
  edb76abe
- Merge branch 'preprocess_fix' into 'main' · bba90f79
  Mohammad Shoeybi authored May 14, 2021
```
Add arg needed for tokenizer.

See merge request ADLR/megatron-lm!272
```
  bba90f79
- Add arg needed for tokenizer. · 2c247afb
  Jared Casper authored May 14, 2021
  
  2c247afb
- Merge branch 'numpy_seed' into 'main' · 37475717
  Jared Casper authored May 14, 2021
```
Ensure numpy random seed is within range.

See merge request ADLR/megatron-lm!271
```
  37475717
- Ensure numpy random seed is within range. · 1c4c360f
  Jared Casper authored May 14, 2021
  
  1c4c360f
- Merge branch 'arg_checks' into 'main' · 002cde6b
  Mohammad Shoeybi authored May 14, 2021
```
Update arguments checks.

See merge request ADLR/megatron-lm!270
```
  002cde6b
- Merge branch 't5_docs' into 'main' · 78bad983
  Jared Casper authored May 14, 2021
```
Adding T5 to docs and a bit of cleanup.

See merge request ADLR/megatron-lm!269
```
  78bad983
- Adding T5 to docs and a bit of cleanup. · 306eb24e
  Jared Casper authored May 14, 2021
  
  306eb24e
- Update arguments checks. · 8044c7b4
  Jared Casper authored May 14, 2021
```
hidden_size % attention_heads == 0 is handled above when dealing with kv_channels.

Adding check for decoder sequence length.
```
  8044c7b4
- Merge branch 'v0_checkpoint_fixes' into 'main' · ee76a501
  Jared Casper authored May 14, 2021
```
fixed compatiblity with v0 checkpoints

See merge request ADLR/megatron-lm!268
```
  ee76a501
- fixed compatiblity with v0 checkpoints · 26b49aab
  mohammad authored May 14, 2021
  
  26b49aab
- debugging DPR · dca47cfb
  Mostofa Patwary authored May 14, 2021
  
  dca47cfb
13 May, 2021 1 commit
- evaluation works! · f64977fd
  Mostofa Patwary authored May 13, 2021
  
  f64977fd
12 May, 2021 4 commits
- added pre ad post process · 7e335e15
  Mostofa Patwary authored May 12, 2021
  
  7e335e15
- added pre ad post process · 54093417
  Mostofa Patwary authored May 12, 2021
  
  54093417
- fixing model evaluation of retriver · f9267205
  Mostofa Patwary authored May 12, 2021
  
  f9267205
- DPR finetune and evaluation · 6d03d7af
  Mostofa Patwary authored May 11, 2021
  
  6d03d7af
11 May, 2021 2 commits
- DPR ongoing · d2d5086e
  Mostofa Patwary authored May 11, 2021
  
  d2d5086e
- DPR evaluation debugging · 220637f9
  Mostofa Patwary authored May 11, 2021
  
  220637f9
29 Apr, 2021 4 commits
- removed commnets · a8d172b3
  Mostofa Patwary authored Apr 28, 2021
  
  a8d172b3
- removed commnets · f415dc85
  mpatwary authored Apr 28, 2021
  
  f415dc85
- removed commnets · 80047314
  mpatwary authored Apr 28, 2021
  
  80047314
- adding dpr code · b9fcb7b4
  mpatwary authored Apr 28, 2021
  
  b9fcb7b4
26 Apr, 2021 1 commit
- Merge branch 'main' into main_retriver_merge_dpr · 957d1c9a
  Mostofa Patwary authored Apr 26, 2021
  
  957d1c9a
23 Apr, 2021 1 commit
- implementation dpr · 06076c7a
  Mostofa Patwary authored Apr 23, 2021
  
  06076c7a
22 Apr, 2021 3 commits
- Merge branch 't5_merge' into 'main' · 2ff004ac
  Mohammad Shoeybi authored Apr 22, 2021
```
Integrate code from t5_main into existing code.

See merge request ADLR/megatron-lm!261
```
  2ff004ac
- Merge branch 'main_generate' into 'main' · 716a3243
  Jared Casper authored Apr 22, 2021
```
lm evaluation

See merge request ADLR/megatron-lm!262
```
  716a3243
- Merge branch 'main_dedup' into 'main' · 7a5768ac
  Jared Casper authored Apr 22, 2021
```
Training data and task deduplication

See merge request ADLR/megatron-lm!252
```
  7a5768ac
21 Apr, 2021 1 commit
- addressed comments · e5ec27d7
  Mostofa Patwary authored Apr 21, 2021
  
  e5ec27d7