Commits · 83d26f036154dfad8cab59a26425c2bccb1089de · OpenDAS / Megatron-LM

03 Mar, 2021 6 commits
- Merge branch 'main_retriver_merge_ict_eval' into 'main' · 83d26f03
  Jared Casper authored Mar 03, 2021
```
Retrieval index building

See merge request ADLR/megatron-lm!239
```
  83d26f03
- Merge branch 'remove_ring_exchange' into 'main' · 788b59e7
  Jared Casper authored Mar 03, 2021
```
Get PyTorch batched communication API working for interleaved schedule

See merge request ADLR/megatron-lm!242
```
  788b59e7
- Merge branch 'remove_stall_timing' into 'main' · 1acac4e3
  Jared Casper authored Mar 03, 2021
```
Remove pipeline stall timing

See merge request ADLR/megatron-lm!244
```
  1acac4e3
- Remove pipeline stall timing (and avoid Explorer perf regressions) · ab09d819
  Deepak Narayanan authored Mar 03, 2021
  
  ab09d819
- Bring back call to ring_exchange() in _communicate() · cbad126a
  Deepak Narayanan authored Mar 03, 2021
  
  cbad126a
- Get PyTorch batched communication API working for interleaved schedule · 78cf869f
  Deepak Narayanan authored Feb 25, 2021
  
  78cf869f
27 Feb, 2021 1 commit

Merge branch 'deadlock_fix' into 'main' · 3cbf7547

Jared Casper authored Feb 27, 2021

Fix deadlock when get_num_microbatches() < pipeline-parallel size

See merge request ADLR/megatron-lm!243

3cbf7547

26 Feb, 2021 3 commits
- Fix deadlock when get_num_microbatches() < pipeline-parallel size (don't try... · 08ddde0c
  Deepak Narayanan authored Feb 26, 2021
```
Fix deadlock when get_num_microbatches() < pipeline-parallel size (don't try to measure pipeline stall)
```
  08ddde0c
- Merge branch 'torch_ddp' into 'main' · 854c3409
  Jared Casper authored Feb 26, 2021
```
Support Torch DDP for single-stage, num_microbatches() > 1

See merge request ADLR/megatron-lm!240
```
  854c3409
- Support Torch DDP for single-stage, num_microbatches() > 1 · 65eeb427
  Deepak Narayanan authored Feb 24, 2021
  
  65eeb427
25 Feb, 2021 3 commits
- Merge branch 'no-realm-import' into 'main' · 8cd16667
  Mohammad Shoeybi authored Feb 25, 2021
```
Don't import deprecated model from realm_model which is broken.

See merge request ADLR/megatron-lm!241
```
  8cd16667
- Don't import deprecated model from realm_model which is broken. · c6f18ccf
  Jared Casper authored Feb 25, 2021
  
  c6f18ccf
- Merge branch 'kernel_warning' into 'main' · 77d54fbb
  Jared Casper authored Feb 25, 2021
```
fix warning condition

See merge request ADLR/megatron-lm!238
```
  77d54fbb
23 Feb, 2021 5 commits
- added script for creating embeddings · edf475ff
  Mostofa Patwary authored Feb 23, 2021
  
  edf475ff
- Merge branch 'main' into main_retriver_merge_ict_eval · 60c95ab6
  Mostofa Patwary authored Feb 23, 2021
  
  60c95ab6
- Added code for building embeddings and savings · bcd605f8
  Mostofa Patwary authored Feb 23, 2021
  
  bcd605f8
- fix warning condition · e055f3cf
  Vijay Korthikanti authored Feb 22, 2021
  
  e055f3cf
- Merge branch 'main_dedup' into 'main' · a1f4032b
  Jared Casper authored Feb 22, 2021
```
Storing and loading fingerprints of in deduplication

See merge request ADLR/megatron-lm!236
```
  a1f4032b
22 Feb, 2021 3 commits
- addressed the comments · ebc4a408
  Mostofa Patwary authored Feb 22, 2021
  
  ebc4a408
- Merge branch 'interleaved_schedule_assertion_fix' into 'main' · 90623142
  Jared Casper authored Feb 22, 2021
```
Fix interleaved schedule assertion

See merge request ADLR/megatron-lm!237
```
  90623142
- Fix interleaved schedule assertion · b7067cbd
  Deepak Narayanan authored Feb 22, 2021
  
  b7067cbd
19 Feb, 2021 5 commits
- Merge branch 'main_retriver_merge' into main_retriver_merge_ict_eval · 31d39ec0
  Mostofa Patwary authored Feb 19, 2021
  
  31d39ec0
- updated the readme · 5a867963
  Mostofa Patwary authored Feb 19, 2021
  
  5a867963
- now multiple pickle files can be added · 4b821fb5
  Mostofa Patwary authored Feb 19, 2021
  
  4b821fb5
- Added an example · f6ddeca0
  Mostofa Patwary authored Feb 18, 2021
  
  f6ddeca0
- added storing and loading of pickle file of hash · 2f6e46bd
  Mostofa Patwary authored Feb 18, 2021
  
  2f6e46bd
18 Feb, 2021 10 commits
- Merge branch 'main_jaccard' into 'main' · 9dc111cc
  Jared Casper authored Feb 18, 2021
```
Bug Jaccard similarity and filtering n-grams

See merge request ADLR/megatron-lm!234
```
  9dc111cc
- Merge branch 'main_retriver_merge' into 'main' · dfd428cb
  Jared Casper authored Feb 18, 2021
```
ICT Retriever

See merge request ADLR/megatron-lm!235
```
  dfd428cb
- addressed the comments · 3f3ba5e7
  Mostofa Patwary authored Feb 18, 2021
  
  3f3ba5e7
- added readme · a449d312
  Mostofa Patwary authored Feb 18, 2021
  
  a449d312
- fixed an issue with ICT · 3d96729a
  Mostofa Patwary authored Feb 17, 2021
  
  3d96729a
- Merge branch 'main_retriver_merge' into 'main' · 68233932
  Jared Casper authored Feb 17, 2021
```
Merge ICT Retriever with Main branch

See merge request ADLR/megatron-lm!227
```
  68233932
- fixed a minor bug · 816fb890
  Mostofa Patwary authored Feb 17, 2021
  
  816fb890
- pulled latest megatron · b2f57fc4
  Mostofa Patwary authored Feb 17, 2021
  
  b2f57fc4
- evaluation code ongoing · 612f438a
  Mostofa Patwary authored Feb 17, 2021
  
  612f438a
- Merge branch 'better_schedule' into 'main' · 76e3fca0
  Jared Casper authored Feb 17, 2021
```
Interleaved pipelined execution and refactored schedule / communication code

See merge request ADLR/megatron-lm!189
```
  76e3fca0
17 Feb, 2021 4 commits
- Merge branch 'main_retriver_merge' into main_retriver_merge_ict_eval · ebc95c35
  Mostofa Patwary authored Feb 17, 2021
  
  ebc95c35
- filtering n-grams · 59372322
  Mostofa Patwary authored Feb 17, 2021
  
  59372322
- Fixed a minor bug · 0a158128
  Mostofa Patwary authored Feb 17, 2021
  
  0a158128
- Turn scatter-gather optimization on by default · 72e4230b
  Deepak Narayanan authored Feb 16, 2021
  
  72e4230b