Commits · 87bd026a6dc367467df336eb430c85ece5f3ebe9 · OpenDAS / Megatron-LM

"src/diffusers/pipelines/latte/pipeline_latte.py" did not exist on "a89a14fa7af77a719de1a011651af5d670cc7cf9"

11 Apr, 2020 2 commits
- Update initialize.py · 87bd026a
  Raul Puri authored Apr 10, 2020
  
  87bd026a
- Added logic for initilialize_megatron to work with cpu only jobs. This is... · 5448ca25
  Raul Puri authored Apr 10, 2020
```
Added logic for initilialize_megatron to work with cpu only jobs. This is necessary for several evaluation and processing scripts in downstream repos.
```
  5448ca25
03 Apr, 2020 4 commits
- Lint megatron/data/dataset_utils.py · 840759b8
  Neel Kant authored Apr 03, 2020
  
  840759b8
- sample generation runs · fffa0497
  Mohammad authored Apr 02, 2020
  
  fffa0497
- code runs · 752eeae3
  Mohammad authored Apr 02, 2020
  
  752eeae3
- working on refactoring text generation · ce29d4d5
  Mohammad authored Apr 02, 2020
  
  ce29d4d5
02 Apr, 2020 2 commits
- some changes to args · 2bd6196c
  Mohammad authored Apr 02, 2020
  
  2bd6196c
- refactored evaluate_gpt2 · 8fae1cdd
  Mohammad authored Apr 01, 2020
  
  8fae1cdd
01 Apr, 2020 1 commit
- addressed comments from raul, neel, and jared · bf3ce751
  Mohammad authored Apr 01, 2020
  
  bf3ce751
31 Mar, 2020 2 commits
- deprecated data_utils · 8600642e
  Mohammad authored Mar 31, 2020
  
  8600642e
- arguments in the model refactored · deffcb6a
  Mohammad authored Mar 31, 2020
  
  deffcb6a
30 Mar, 2020 7 commits
- removed unused values in samplers · 259062c2
  Mohammad authored Mar 30, 2020
  
  259062c2
- added samplers from data_utils · 32e1ddb0
  Mohammad authored Mar 30, 2020
  
  32e1ddb0
- removed building tokenizer from bert dataset · dedb2ef7
  Mohammad authored Mar 30, 2020
  
  dedb2ef7
- both bert and gpt2 tested and working · 1788c910
  Mohammad authored Mar 29, 2020
  
  1788c910
- both bert and gpt are working · 5f8623db
  Mohammad authored Mar 29, 2020
  
  5f8623db
- added gpt2 tokenizer · 46379244
  Mohammad authored Mar 29, 2020
  
  46379244
- added gpt2 tokenizer · 0e5dfd7f
  Mohammad authored Mar 29, 2020
  
  0e5dfd7f
29 Mar, 2020 4 commits
- refactored learning-rate · b6e0377b
  Mohammad authored Mar 29, 2020
  
  b6e0377b
- refactored training · 27e14f82
  Mohammad authored Mar 28, 2020
  
  27e14f82
- utils partially refactored and tested · 3f58649b
  Mohammad authored Mar 28, 2020
  
  3f58649b
- refactored checkpooints but not tested yet · 86e7d624
  Mohammad authored Mar 28, 2020
  
  86e7d624
28 Mar, 2020 4 commits
- tokenizer moved to its own directory · 11220df8
  Mohammad authored Mar 28, 2020
  
  11220df8
- working on utils · 5050203f
  Mohammad authored Mar 28, 2020
  
  5050203f
- arguments.py refactored · 94e2ca57
  Mohammad authored Mar 27, 2020
  
  94e2ca57
- added initialize megatron · a9e19f8e
  Mohammad authored Mar 27, 2020
  
  a9e19f8e
27 Mar, 2020 2 commits
- added global variables · 83aa9219
  Mohammad authored Mar 27, 2020
  
  83aa9219
- working on bert · 599e959a
  Mohammad authored Mar 26, 2020
  
  599e959a
24 Mar, 2020 1 commit
- BERT downstream tasks: RACE, MNLI, QQP · 90ef2e28
  Mohammad Shoeybi authored Mar 23, 2020
  
  90ef2e28
17 Mar, 2020 1 commit
- moved albert to bert · 09e05c6f
  Mohammad Shoeybi authored Mar 16, 2020
  
  09e05c6f
11 Mar, 2020 1 commit
- memory optimization in mpu cross entropy · 57064fd6
  Mohammad Shoeybi authored Mar 10, 2020
  
  57064fd6
10 Feb, 2020 1 commit
- Model parallel merger · 57c2060f
  Mohammad Shoeybi authored Feb 10, 2020
  
  57c2060f
17 Jan, 2020 1 commit
- undid padding merge · 7a6d630e
  Raul Puri authored Jan 16, 2020
  
  7a6d630e
14 Jan, 2020 3 commits
- added query-key layer scaling and softmax fp32 option · 6c2d0337
  Mohammad Shoeybi authored Jan 13, 2020
  
  6c2d0337
- added query-key layer scaling and softmax fp32 option · 691747b1
  Mohammad Shoeybi authored Jan 13, 2020
  
  691747b1
- exponential learning rate decay added · 7a3b4c15
  Mohammad Shoeybi authored Jan 13, 2020
  
  7a3b4c15
26 Dec, 2019 2 commits
- reverted init in data_utils · b8e0129f
  Mohammad Shoeybi authored Dec 26, 2019
  
  b8e0129f
- changed long seq length to 512 · 43dd21f7
  Mohammad Shoeybi authored Dec 26, 2019
  
  43dd21f7
25 Dec, 2019 1 commit
- added filtering based on sentence length · 2c58c9b0
  Mohammad Shoeybi authored Dec 24, 2019
  
  2c58c9b0
22 Dec, 2019 1 commit
- force output gathering · b9b6fe0d
  Raul Puri authored Dec 22, 2019
  
  b9b6fe0d