Commits · 0c01c2feb41e6d3af06a1be333e3cf1931e0ef0a · OpenDAS / Megatron-LM

30 Mar, 2021 1 commit
- fix one more issue · 0c01c2fe
  Mostofa Patwary authored Mar 29, 2021
  
  0c01c2fe
26 Mar, 2021 1 commit
- added parallelism for computing jaccard similaity · 43d307d5
  mpatwary authored Mar 25, 2021
  
  43d307d5
19 Mar, 2021 1 commit
- Added more feature in train data deduplication · 882683dc
  Mostofa Patwary authored Mar 19, 2021
  
  882683dc
08 Mar, 2021 1 commit
- Added code to cleanup and fix code · 47e7eb80
  Mostofa Patwary authored Mar 08, 2021
  
  47e7eb80
05 Mar, 2021 3 commits
- Fixed a bug · 9c2eb971
  Mostofa Patwary authored Mar 05, 2021
  
  9c2eb971
- Many more features added · b35e15f2
  Mostofa Patwary authored Mar 04, 2021
  
  b35e15f2
- Many more features added · c44f7622
  Mostofa Patwary authored Mar 04, 2021
  
  c44f7622
02 Mar, 2021 1 commit
- Dedup for other tasks added · 6013e23c
  Mostofa Patwary authored Mar 02, 2021
  
  6013e23c
26 Feb, 2021 3 commits
- Updated readme · b08b5edc
  Mostofa Patwary authored Feb 26, 2021
  
  b08b5edc
- added threads · a29890c3
  Mostofa Patwary authored Feb 26, 2021
  
  a29890c3
- Other tasks dedup added · 90c9e3f2
  Mostofa Patwary authored Feb 25, 2021
  
  90c9e3f2
22 Feb, 2021 1 commit
- addressed the comments · ebc4a408
  Mostofa Patwary authored Feb 22, 2021
  
  ebc4a408
19 Feb, 2021 4 commits
- updated the readme · 5a867963
  Mostofa Patwary authored Feb 19, 2021
  
  5a867963
- now multiple pickle files can be added · 4b821fb5
  Mostofa Patwary authored Feb 19, 2021
  
  4b821fb5
- Added an example · f6ddeca0
  Mostofa Patwary authored Feb 18, 2021
  
  f6ddeca0
- added storing and loading of pickle file of hash · 2f6e46bd
  Mostofa Patwary authored Feb 18, 2021
  
  2f6e46bd
18 Feb, 2021 1 commit
- added readme · a449d312
  Mostofa Patwary authored Feb 18, 2021
  
  a449d312
17 Feb, 2021 2 commits
- filtering n-grams · 59372322
  Mostofa Patwary authored Feb 17, 2021
  
  59372322
- Fixed a minor bug · 0a158128
  Mostofa Patwary authored Feb 17, 2021
  
  0a158128
08 Feb, 2021 2 commits
- Merge branch 'ckpt_rng' into 'main' · c1faa9fe
  Mohammad Shoeybi authored Feb 08, 2021
```
Improve handling of rng states in checkpoints.

See merge request ADLR/megatron-lm!231
```
  c1faa9fe
- Improve handling of rng states in checkpoints. · 08a848c7
  Jared Casper authored Feb 08, 2021
  
  08a848c7
06 Feb, 2021 1 commit

Merge branch 'main_fix' into 'main' · 8863af8c

Jared Casper authored Feb 05, 2021

Use torch.cuda.synchronize() right after calling batch_isend_irecv() communication API

See merge request ADLR/megatron-lm!230

8863af8c

05 Feb, 2021 3 commits
- Use torch.cuda.synchronize() right after calling batch_isend_irecv() communication API · 7ffea978
  Deepak Narayanan authored Feb 05, 2021
  
  7ffea978
- Merge branch 'fused_kernel_cond' into 'main' · 2096d356
  Jared Casper authored Feb 05, 2021
```
conditioning fused kernels

See merge request ADLR/megatron-lm!228
```
  2096d356
- address review comments · 0cb36de2
  Vijay Korthikanti authored Feb 05, 2021
  
  0cb36de2
04 Feb, 2021 1 commit
- conditioning fused kernels · 4916bae6
  Vijay Korthikanti authored Feb 04, 2021
  
  4916bae6
02 Feb, 2021 2 commits
- Merge branch 'merge_bugfix' into 'main' · 872e38ea
  Mohammad Shoeybi authored Feb 02, 2021
```
Fix bug in merge_mp_partitions for handling recent checkpoints.

See merge request ADLR/megatron-lm!226
```
  872e38ea
- Fix bug in merge_mp_partitions for handling recent checkpoints. · 72105ef0
  Jared Casper authored Feb 02, 2021
  
  72105ef0
01 Feb, 2021 2 commits
- Merge branch 'preprocess_fix' into 'main' · c601d751
  Mohammad Shoeybi authored Feb 01, 2021
```
Handle empty documents in preprocess_data.

See merge request ADLR/megatron-lm!225
```
  c601d751
- Handle empty documents in preprocess_data. · 09d220cf
  Jared Casper authored Feb 01, 2021
  
  09d220cf
29 Jan, 2021 4 commits
- Merge branch 'ci' into 'main' · 1b8e2891
  Jared Casper authored Jan 29, 2021
```
Init CI tests with very basic import test.

See merge request ADLR/megatron-lm!224
```
  1b8e2891
- Init CI tests with very basic import test. · 2526c614
  Jared Casper authored Jan 29, 2021
  
  2526c614
- Merge branch 'tensorboard_queue_size_increase' into 'main' · f2a3a25c
  Jared Casper authored Jan 29, 2021
```
added option to change tensorboard queue size

See merge request ADLR/megatron-lm!223
```
  f2a3a25c
- added option to change tensorboard queue size · e9b90500
  mohammad authored Jan 29, 2021
  
  e9b90500
28 Jan, 2021 6 commits
- Merge branch 'logging_refactor' into 'main' · 0e5b64af
  Jared Casper authored Jan 28, 2021
```
added options for tensorboard logging

See merge request ADLR/megatron-lm!222
```
  0e5b64af
- changed validation loss name · 792a468d
  mohammad authored Jan 28, 2021
  
  792a468d
- added options for tensorboard logging · 3a26a168
  mohammad authored Jan 28, 2021
  
  3a26a168
- Merge branch 'ckpt_fix' into 'main' · 16db4a2c
  Mohammad Shoeybi authored Jan 28, 2021
```
Typo fix.

See merge request ADLR/megatron-lm!221
```
  16db4a2c
- Typo fix. · e1f574cd
  Jared Casper authored Jan 28, 2021
  
  e1f574cd
- Merge branch 'ckpt_merge' into 'main' · 36c2674c
  Mohammad Shoeybi authored Jan 28, 2021
```
Teach merge_mp_partitions how to write out a pipelined model.

See merge request ADLR/megatron-lm!218
```
  36c2674c