Commits · c1e4526bb35f29ac45077e5243530215d4b6e63c · OpenDAS / Megatron-LM

13 Jan, 2022 4 commits
- renamed 'free' -> 'deallocate' · c1e4526b
  Lawrence McAfee authored Jan 13, 2022
  
  c1e4526b
- removed uses are args.deallocate_pipeline_output · d10f81c5
  Lawrence McAfee authored Jan 13, 2022
  
  d10f81c5
- removed argument flag; also, converted torch.FloatTenstor -> torch.empty in previous commit · 18846a0a
  Lawrence McAfee authored Jan 13, 2022
  
  18846a0a
- fixed bug for no-interleave pipeline schedule · 1f387c2c
  Lawrence McAfee authored Jan 13, 2022
  
  1f387c2c
05 Jan, 2022 1 commit
- Merge branch 'free-pipe-output-t5-fix' into 'main' · 9a8b89ac
  Jared Casper authored Jan 04, 2022
```
added flag to control deallocation of pipeline outputs

See merge request ADLR/megatron-lm!377
```
  9a8b89ac
04 Jan, 2022 3 commits
- added flag to control deallocation of pipeline outputs · de1ae5b2
  Lawrence McAfee authored Jan 04, 2022
  
  de1ae5b2
- Merge branch 't5_pipeline_fixes' into 'main' · 2de7ae27
  Jared Casper authored Jan 04, 2022
```
Generic fix to T5 pipeline parallelism bug.

See merge request ADLR/megatron-lm!376
```
  2de7ae27
- update comment · d439b417
  Vijay Korthikanti authored Jan 04, 2022
  
  d439b417
31 Dec, 2021 1 commit
- simplify code · 9da6e975
  Vijay Korthikanti authored Dec 30, 2021
  
  9da6e975
30 Dec, 2021 2 commits
- avoid allocation of word embedding for head in T5 pp=2 case · ade99d61
  Vijay Korthikanti authored Dec 30, 2021
  
  ade99d61
- fixing the corner case pp=2 · 26ea8314
  Vijay Korthikanti authored Dec 30, 2021
  
  26ea8314
21 Dec, 2021 4 commits
- Merge branch 't5_pipeline_fixes' into 'main' · 9d86ca67
  Jared Casper authored Dec 21, 2021
```
pipeline_fixes

See merge request ADLR/megatron-lm!372
```
  9d86ca67
- comments · 81ad628e
  Vijay Korthikanti authored Dec 21, 2021
  
  81ad628e
- Merge branch 'lmcafee/free-pipe-output' into 'main' · 057b086c
  Jared Casper authored Dec 21, 2021
```
Deallocate pipeline stage output tensors after sending

See merge request ADLR/megatron-lm!370
```
  057b086c
- Merge branch 'multistage-prompting/main-multistage' into 'main' · 5833553a
  Jared Casper authored Dec 21, 2021
```
Multistage prompting/main multistage

See merge request ADLR/megatron-lm!371
```
  5833553a
17 Dec, 2021 2 commits
- minor fixes · f2bf5a56
  Vijay Korthikanti authored Dec 17, 2021
  
  f2bf5a56
- pipeline_fixes · 17843605
  Vijay Korthikanti authored Dec 17, 2021
  
  17843605
14 Dec, 2021 4 commits
- change directory name to msdp · b8707ee2
  zihanl authored Dec 13, 2021
  
  b8707ee2
- change directory name · 4e48efdf
  zihanl authored Dec 13, 2021
  
  4e48efdf
- change directory name · f24c972c
  zihanl authored Dec 13, 2021
  
  f24c972c
- restore to original main.py · 86e54454
  zihanl authored Dec 13, 2021
  
  86e54454
11 Dec, 2021 1 commit
- update api prompt · fc06e7a2
  zihanl authored Dec 10, 2021
  
  fc06e7a2
10 Dec, 2021 13 commits
- output tensor now allocated directly on gpu. · 85876092
  Lawrence McAfee authored Dec 10, 2021
  
  85876092
- Updated README · 57c8996e
  Mostofa Patwary authored Dec 10, 2021
  
  57c8996e
- Updated readme · 290ad54d
  Mostofa Patwary authored Dec 10, 2021
  
  290ad54d
- added additional README · da6c05be
  Mostofa Patwary authored Dec 10, 2021
  
  da6c05be
- delete interactive file · 7122b878
  zihanl authored Dec 09, 2021
  
  7122b878
- delete utils.py · 951ef3ae
  zihanl authored Dec 09, 2021
  
  951ef3ae
- update README.md · bd66eb30
  zihanl authored Dec 09, 2021
  
  bd66eb30
- update README.md · fb27a6c1
  zihanl authored Dec 09, 2021
  
  fb27a6c1
- add out_seq_length for api prompt · 53dc7e6e
  zihanl authored Dec 09, 2021
  
  53dc7e6e
- add knwl_dialo scripts · e755f6fd
  zihanl authored Dec 09, 2021
  
  e755f6fd
- delete files · f322c788
  zihanl authored Dec 09, 2021
  
  f322c788
- use new text generation · ccf0eae2
  zihanl authored Dec 09, 2021
  
  ccf0eae2
- add api argument · b3cd8a47
  zihanl authored Dec 09, 2021
  
  b3cd8a47
09 Dec, 2021 5 commits
- Merge branch 't5_pipeline_fixes' into 'main' · 945ece94
  Jared Casper authored Dec 09, 2021
```
t5_pipeline_fix

See merge request ADLR/megatron-lm!353
```
  945ece94
- update commands.sh · 48dbd9ca
  zihanl authored Dec 09, 2021
  
  48dbd9ca
- update commands.sh · 7736db1b
  zihanl authored Dec 09, 2021
  
  7736db1b
- add api option · 5f433016
  zihanl authored Dec 09, 2021
  
  5f433016
- update README.md · fec9668d
  zihanl authored Dec 08, 2021
  
  fec9668d