Commits · 06076c7ad28ed32cf91faad940e68bce191d3040 · OpenDAS / Megatron-LM

23 Apr, 2021 1 commit
- implementation dpr · 06076c7a
  Mostofa Patwary authored Apr 23, 2021
  
  06076c7a
09 Apr, 2021 2 commits
- Merge branch 'main' into main_retriver_merge_dpr · cdde4338
  Mostofa Patwary authored Apr 09, 2021
  
  cdde4338
- implementing DPR · 10ff0607
  Mostofa Patwary authored Apr 09, 2021
  
  10ff0607
08 Apr, 2021 2 commits
- Merge branch 'release_fixes' into 'main' · 8cfef1bf
  Deepak Narayanan authored Apr 08, 2021
```
Release fixes

See merge request ADLR/megatron-lm!258
```
  8cfef1bf
- Release fixes · 50a4b5fa
  Mohammad Shoeybi authored Apr 08, 2021
  
  50a4b5fa
03 Apr, 2021 3 commits
- Merge branch 'interleaved_bugfix' into 'main' · 23632ee5
  Mohammad Shoeybi authored Apr 03, 2021
```
Small bugfix to make sure refactored code works with interleaved schedule

See merge request ADLR/megatron-lm!256
```
  23632ee5
- Small bugfix to make sure refactored code works with interleaved schedule · 6fd78189
  Deepak Narayanan authored Apr 03, 2021
  
  6fd78189
- Merge branch 'pipeline_refactor' into 'main' · 3fc035d7
  Mohammad Shoeybi authored Apr 03, 2021
```
Pipeline refactor

See merge request ADLR/megatron-lm!254
```
  3fc035d7
02 Apr, 2021 1 commit
- Addressed MR comments, mostly adding comments to code. · e270f68a
  Jared Casper authored Apr 02, 2021
  
  e270f68a
31 Mar, 2021 2 commits
- Merge branch 'bfloat_jit' into 'main' · f2d64c00
  Mohammad Shoeybi authored Mar 31, 2021
```
removed the checks for bfloat jitting

See merge request ADLR/megatron-lm!255
```
  f2d64c00
- removed the checks for bfloat jitting · d28716e8
  mshoeybi authored Mar 30, 2021
  
  d28716e8
24 Mar, 2021 3 commits
- Fixing text generation and zeroshot eval and addressing comments. · 64a83fb5
  Jared Casper authored Mar 24, 2021
  
  64a83fb5
- Tasks seems to be working. · b938ec51
  Jared Casper authored Mar 23, 2021
  
  b938ec51
- pipeline code simplification · 3b91262e
  Vijay Korthikanti authored Mar 02, 2021
  
  3b91262e
23 Mar, 2021 1 commit

Merge branch 'extra_assertion' into 'main' · 2f3a2d68

Jared Casper authored Mar 23, 2021

Make sure pipeline-model-parallel size is greater than 2 for interleaved schedule

See merge request ADLR/megatron-lm!253

2f3a2d68

20 Mar, 2021 2 commits
- Make sure pipeline-model-parallel size is greater than 2 for interleaved schedule · 182841f7
  Deepak Narayanan authored Mar 20, 2021
  
  182841f7
- Merge branch 'main' into main_retriver_merge_ict_eval · a5acbf53
  Mostofa Patwary authored Mar 19, 2021
  
  a5acbf53
19 Mar, 2021 6 commits
- Merge branch 'main_retriver_merge_ict_eval' into 'main' · a6e00d97
  Jared Casper authored Mar 19, 2021
```
ICT zeroshot evaluation

See merge request ADLR/megatron-lm!248
```
  a6e00d97
- ICT zeroshot evaluation · fcfd0949
  Mostofa Patwary authored Mar 19, 2021
  
  fcfd0949
- fixed another issue · 40565390
  Mostofa Patwary authored Mar 19, 2021
  
  40565390
- Merge branch 'bfloat_fused_softmax' into 'main' · c5346794
  Jared Casper authored Mar 19, 2021
```
Bfloat fused softmax + fused layer norm

See merge request ADLR/megatron-lm!251
```
  c5346794
- Bfloat fused softmax + fused layer norm · 0fa7175f
  Mohammad Shoeybi authored Mar 19, 2021
  
  0fa7175f
- Fixed based on review recoemmendation · 43c9137b
  Mostofa Patwary authored Mar 18, 2021
  
  43c9137b
18 Mar, 2021 2 commits
- Merge branch 'ninja_compilation_fix' into 'main' · d9b1c681
  Jared Casper authored Mar 18, 2021
```
refactored the fused kernels build

See merge request ADLR/megatron-lm!250
```
  d9b1c681
- refactored the fused kernels build · 0d5188c1
  Mohammad Shoeybi authored Mar 17, 2021
  
  0d5188c1
17 Mar, 2021 2 commits
- Merge branch 'softmax_perf' into 'main' · 876096d5
  Jared Casper authored Mar 17, 2021
```
softmax data load/store optimization

See merge request ADLR/megatron-lm!249
```
  876096d5
- fixes to upper triangular masked softmax fusion kernel · 3b12ab15
  Vijay Korthikanti authored Mar 16, 2021
  
  3b12ab15
16 Mar, 2021 2 commits
- minor fixes · 531152d9
  Vijay Korthikanti authored Mar 16, 2021
  
  531152d9
- softmax data load/store optimization · b1a83375
  Vijay Korthikanti authored Mar 16, 2021
  
  b1a83375
11 Mar, 2021 1 commit
- made more generic, aligned with other tasks · 661553f6
  Mostofa Patwary authored Mar 11, 2021
  
  661553f6
10 Mar, 2021 1 commit
- ICT zeroshot evaluation code · 8b04e0e4
  Mostofa Patwary authored Mar 10, 2021
  
  8b04e0e4
08 Mar, 2021 2 commits
- Merge branch 'bfloat_with_fp32_grad_acc' into 'main' · 1a2cb60c
  Jared Casper authored Mar 08, 2021
```
Bfloat with fp32 grad acc

See merge request ADLR/megatron-lm!247
```
  1a2cb60c
- Bfloat with fp32 grad acc · b4bc51b1
  Mohammad Shoeybi authored Mar 08, 2021
  
  b4bc51b1
04 Mar, 2021 6 commits
- Merge branch 'rc-debug-underflow' into 'main' · 87b8b9dc
  Jared Casper authored Mar 04, 2021
```
Rc debug underflow

See merge request ADLR/megatron-lm!246
```
  87b8b9dc
- Fix syntax · 57437cb1
  Rewon Child authored Mar 04, 2021
  
  57437cb1
- Update argument names and fix merge error · 0aff3629
  Rewon Child authored Mar 04, 2021
  
  0aff3629
- Merge main · 41a64613
  Rewon Child authored Mar 04, 2021
  
  41a64613
- Update comments · 8676baca
  Rewon Child authored Mar 04, 2021
  
  8676baca
- Merge branch 'main' into rc-debug-underflow · 14c85e64
  Rewon Child authored Mar 04, 2021
  
  14c85e64
03 Mar, 2021 1 commit
- Merge branch 'main_retriver_merge_ict_eval' into 'main' · 83d26f03
  Jared Casper authored Mar 03, 2021
```
Retrieval index building

See merge request ADLR/megatron-lm!239
```
  83d26f03