Commits · 09c2f6e4aab2e2e4fea9f07795742c5866fd0a7a · OpenDAS / Megatron-LM

23 Mar, 2023 1 commit
- Add contiguous to grad_output in layers.py · 09c2f6e4
  Markel Ausin authored Mar 22, 2023
  
  09c2f6e4
16 Mar, 2023 4 commits
- Merge branch 'merge_req' into 'main' · b7f3c263
  Jared Casper authored Mar 16, 2023
```
Update .gitlab-ci.yml

See merge request ADLR/megatron-lm!540
```
  b7f3c263
- Update .gitlab-ci.yml · 6289787b
  Shanmugam Ramasamy authored Mar 16, 2023
  
  6289787b
- Merge branch 'UpdateTests' into 'main' · 7aceba87
  Shanmugam Ramasamy authored Mar 16, 2023
```
Update .gitlab-ci.yml

See merge request ADLR/megatron-lm!537
```
  7aceba87
- Update .gitlab-ci.yml · 9eb04e96
  Shanmugam Ramasamy authored Mar 16, 2023
  
  9eb04e96
14 Mar, 2023 2 commits
- Merge branch 'bugFixRestarting' into 'main' · 21c19e81
  Shanmugam Ramasamy authored Mar 14, 2023
```
Update .gitlab-ci.yml to support restarting pipeline

See merge request ADLR/megatron-lm!534
```
  21c19e81
- Update .gitlab-ci.yml to support restarting pipeline · 89a9f399
  Shanmugam Ramasamy authored Mar 14, 2023
  
  89a9f399
09 Mar, 2023 2 commits
- Merge branch 'maanug/gpt-text-gen' into 'main' · 636da044
  Jared Casper authored Mar 09, 2023
```
Fix GPT text generation

See merge request ADLR/megatron-lm!528
```
  636da044
- Fix GPT text generation · 3c760180
  Maanu Grover authored Mar 09, 2023
  
  3c760180
08 Mar, 2023 2 commits
- Merge branch 'citest' into 'main' · f5cf2e42
  Jared Casper authored Mar 08, 2023
```
Testing infrastructure for Megatron core

See merge request ADLR/megatron-lm!514
```
  f5cf2e42
- Testing infrastructure for Megatron core · 8e6fa622
  Shanmugam Ramasamy authored Mar 08, 2023
  
  8e6fa622
22 Feb, 2023 6 commits
- Merge branch 'maanug/readme-pretraining' into 'main' · 95f872f5
  Jared Casper authored Feb 21, 2023
```
Pretraining README update

See merge request ADLR/megatron-lm!512
```
  95f872f5
- Pretraining README update · 5ecd52a4
  Maanu Grover authored Feb 21, 2023
  
  5ecd52a4
- Merge branch 'maanug/paper-links' into 'main' · f063bbb5
  Jared Casper authored Feb 21, 2023
```
README: Paper Links

See merge request ADLR/megatron-lm!521
```
  f063bbb5
- README: Paper Links · 23a54e02
  Maanu Grover authored Feb 21, 2023
  
  23a54e02
- Merge branch 'lmcafee/retro' into 'main' · 762072e0
  Jared Casper authored Feb 21, 2023
```
Retro

See merge request ADLR/megatron-lm!489
```
  762072e0
- Retro · 17a6044d
  Lawrence McAfee authored Feb 21, 2023
  
  17a6044d
17 Feb, 2023 6 commits
- Merge branch 'maanug/distributed-pretrain-examples' into 'main' · ef59b687
  Jared Casper authored Feb 17, 2023
```
Fix distributed pretraining examples

See merge request ADLR/megatron-lm!523
```
  ef59b687
- Fix distributed pretraining examples · 94dbfd1c
  Maanu Grover authored Feb 17, 2023
  
  94dbfd1c
- Merge branch 'maanug/readme-pretraining-dist' into 'main' · 0dce440a
  Jared Casper authored Feb 17, 2023
```
Update Distributed Pretraining REAME section

See merge request ADLR/megatron-lm!522
```
  0dce440a
- Update Distributed Pretraining REAME section · 912ab8ad
  Maanu Grover authored Feb 17, 2023
  
  912ab8ad
- Merge branch 'maanug/1gpu-pretrain-examples' into 'main' · 0b208deb
  Jared Casper authored Feb 17, 2023
```
Fix pretraining examples

See merge request ADLR/megatron-lm!513
```
  0b208deb
- Fix pretraining examples · 7625a9d2
  Maanu Grover authored Feb 17, 2023
  
  7625a9d2
11 Jan, 2023 2 commits
- Merge branch 'tridao-flashattn' into 'main' · 285068c8
  Jared Casper authored Jan 11, 2023
```
Integrate FlashAttention into Megatron-LM

See merge request ADLR/megatron-lm!488
```
  285068c8
- Merge branch 'main' into tridao-flashattn · c92f10bd
  Jared Casper authored Jan 11, 2023
  
  c92f10bd
04 Jan, 2023 1 commit
- Remove FA's check for headdim <= 128 · 9200e43a
  Tri Dao authored Jan 03, 2023
  
  9200e43a
03 Jan, 2023 1 commit
- Merge branch 'skyw/fix_zeroshot_eval_script' into 'main' · b7071993
  Jared Casper authored Jan 03, 2023
```
remove mpu dependency in zeroshot script

See merge request ADLR/megatron-lm!493
```
  b7071993
22 Dec, 2022 2 commits
- Merge branch 'transformer_engine_rebase' into 'main' · e1c334b0
  John Kamalu authored Dec 21, 2022
```
Transformer Engine Integration Rebase

See merge request ADLR/megatron-lm!487
```
  e1c334b0
- Transformer Engine Integration Rebase · 3499542e
  John Kamalu authored Dec 21, 2022
  
  3499542e
21 Dec, 2022 1 commit
- remove mpu dependency in zeroshot script · 8ed3887a
  Hao Wu authored Dec 21, 2022
  
  8ed3887a
09 Dec, 2022 1 commit
- Integrate FlashAttention into Megatron-LM · d693034e
  Tri Dao authored Dec 08, 2022
  
  d693034e
29 Nov, 2022 3 commits
- Merge branch 'yuya/drop_path_fix' into 'main' · 52e63688
  Jared Casper authored Nov 29, 2022
```
Fix DropPath for hidden shape [s, b, h]

See merge request ADLR/megatron-lm!485
```
  52e63688
- Merge branch 'partition_fixes' into 'main' · b24f4adc
  Jared Casper authored Nov 29, 2022
```
bug fixes in partitioned data preprocessor

See merge request ADLR/megatron-lm!486
```
  b24f4adc
- bug fixes in partitioned data preprocessor · 84a43b13
  Mike Chrzanowski authored Nov 29, 2022
  
  84a43b13
24 Nov, 2022 2 commits
- Merge branch 'boxin/detoxify_lm_cr' into 'main' · 8ce8256f
  Boxin Wang authored Nov 23, 2022
```
Open sourcing lm detoxification code

See merge request ADLR/megatron-lm!471
```
  8ce8256f
- Open sourcing lm detoxification code · d48d95ab
  Boxin Wang authored Nov 23, 2022
  
  d48d95ab
22 Nov, 2022 1 commit
- Fix DropPath for hidden shape [s, b, h] · 6d45a903
  Yu Yao authored Nov 22, 2022
  
  6d45a903
17 Nov, 2022 2 commits
- Merge branch 'nmt-main' into 'main' · 70169453
  Mike Chrzanowski authored Nov 17, 2022
```
Data Preprocessing Optimizations

See merge request ADLR/megatron-lm!483
```
  70169453
- Data Preprocessing Optimizations · 7fc96111
  Vijay Korthikanti authored Nov 17, 2022
  
  7fc96111
11 Nov, 2022 1 commit

Merge branch 'nmt-main' into 'main' · 1ad1e1b1

Jared Casper authored Nov 10, 2022

Support for variable sequence lengths across micro-batches

See merge request ADLR/megatron-lm!472

1ad1e1b1