Commits · 89a9f39910da7a4d4e537a8434de88e52160297e · OpenDAS / Megatron-LM

14 Mar, 2023 1 commit
- Update .gitlab-ci.yml to support restarting pipeline · 89a9f399
  Shanmugam Ramasamy authored Mar 14, 2023
  
  89a9f399
09 Mar, 2023 2 commits
- Merge branch 'maanug/gpt-text-gen' into 'main' · 636da044
  Jared Casper authored Mar 09, 2023
```
Fix GPT text generation

See merge request ADLR/megatron-lm!528
```
  636da044
- Fix GPT text generation · 3c760180
  Maanu Grover authored Mar 09, 2023
  
  3c760180
08 Mar, 2023 2 commits
- Merge branch 'citest' into 'main' · f5cf2e42
  Jared Casper authored Mar 08, 2023
```
Testing infrastructure for Megatron core

See merge request ADLR/megatron-lm!514
```
  f5cf2e42
- Testing infrastructure for Megatron core · 8e6fa622
  Shanmugam Ramasamy authored Mar 08, 2023
  
  8e6fa622
22 Feb, 2023 6 commits
- Merge branch 'maanug/readme-pretraining' into 'main' · 95f872f5
  Jared Casper authored Feb 21, 2023
```
Pretraining README update

See merge request ADLR/megatron-lm!512
```
  95f872f5
- Pretraining README update · 5ecd52a4
  Maanu Grover authored Feb 21, 2023
  
  5ecd52a4
- Merge branch 'maanug/paper-links' into 'main' · f063bbb5
  Jared Casper authored Feb 21, 2023
```
README: Paper Links

See merge request ADLR/megatron-lm!521
```
  f063bbb5
- README: Paper Links · 23a54e02
  Maanu Grover authored Feb 21, 2023
  
  23a54e02
- Merge branch 'lmcafee/retro' into 'main' · 762072e0
  Jared Casper authored Feb 21, 2023
```
Retro

See merge request ADLR/megatron-lm!489
```
  762072e0
- Retro · 17a6044d
  Lawrence McAfee authored Feb 21, 2023
  
  17a6044d
17 Feb, 2023 6 commits
- Merge branch 'maanug/distributed-pretrain-examples' into 'main' · ef59b687
  Jared Casper authored Feb 17, 2023
```
Fix distributed pretraining examples

See merge request ADLR/megatron-lm!523
```
  ef59b687
- Fix distributed pretraining examples · 94dbfd1c
  Maanu Grover authored Feb 17, 2023
  
  94dbfd1c
- Merge branch 'maanug/readme-pretraining-dist' into 'main' · 0dce440a
  Jared Casper authored Feb 17, 2023
```
Update Distributed Pretraining REAME section

See merge request ADLR/megatron-lm!522
```
  0dce440a
- Update Distributed Pretraining REAME section · 912ab8ad
  Maanu Grover authored Feb 17, 2023
  
  912ab8ad
- Merge branch 'maanug/1gpu-pretrain-examples' into 'main' · 0b208deb
  Jared Casper authored Feb 17, 2023
```
Fix pretraining examples

See merge request ADLR/megatron-lm!513
```
  0b208deb
- Fix pretraining examples · 7625a9d2
  Maanu Grover authored Feb 17, 2023
  
  7625a9d2
11 Jan, 2023 2 commits
- Merge branch 'tridao-flashattn' into 'main' · 285068c8
  Jared Casper authored Jan 11, 2023
```
Integrate FlashAttention into Megatron-LM

See merge request ADLR/megatron-lm!488
```
  285068c8
- Merge branch 'main' into tridao-flashattn · c92f10bd
  Jared Casper authored Jan 11, 2023
  
  c92f10bd
04 Jan, 2023 1 commit
- Remove FA's check for headdim <= 128 · 9200e43a
  Tri Dao authored Jan 03, 2023
  
  9200e43a
03 Jan, 2023 1 commit
- Merge branch 'skyw/fix_zeroshot_eval_script' into 'main' · b7071993
  Jared Casper authored Jan 03, 2023
```
remove mpu dependency in zeroshot script

See merge request ADLR/megatron-lm!493
```
  b7071993
22 Dec, 2022 2 commits
- Merge branch 'transformer_engine_rebase' into 'main' · e1c334b0
  John Kamalu authored Dec 21, 2022
```
Transformer Engine Integration Rebase

See merge request ADLR/megatron-lm!487
```
  e1c334b0
- Transformer Engine Integration Rebase · 3499542e
  John Kamalu authored Dec 21, 2022
  
  3499542e
21 Dec, 2022 1 commit
- remove mpu dependency in zeroshot script · 8ed3887a
  Hao Wu authored Dec 21, 2022
  
  8ed3887a
09 Dec, 2022 1 commit
- Integrate FlashAttention into Megatron-LM · d693034e
  Tri Dao authored Dec 08, 2022
  
  d693034e
29 Nov, 2022 3 commits
- Merge branch 'yuya/drop_path_fix' into 'main' · 52e63688
  Jared Casper authored Nov 29, 2022
```
Fix DropPath for hidden shape [s, b, h]

See merge request ADLR/megatron-lm!485
```
  52e63688
- Merge branch 'partition_fixes' into 'main' · b24f4adc
  Jared Casper authored Nov 29, 2022
```
bug fixes in partitioned data preprocessor

See merge request ADLR/megatron-lm!486
```
  b24f4adc
- bug fixes in partitioned data preprocessor · 84a43b13
  Mike Chrzanowski authored Nov 29, 2022
  
  84a43b13
24 Nov, 2022 2 commits
- Merge branch 'boxin/detoxify_lm_cr' into 'main' · 8ce8256f
  Boxin Wang authored Nov 23, 2022
```
Open sourcing lm detoxification code

See merge request ADLR/megatron-lm!471
```
  8ce8256f
- Open sourcing lm detoxification code · d48d95ab
  Boxin Wang authored Nov 23, 2022
  
  d48d95ab
22 Nov, 2022 1 commit
- Fix DropPath for hidden shape [s, b, h] · 6d45a903
  Yu Yao authored Nov 22, 2022
  
  6d45a903
17 Nov, 2022 2 commits
- Merge branch 'nmt-main' into 'main' · 70169453
  Mike Chrzanowski authored Nov 17, 2022
```
Data Preprocessing Optimizations

See merge request ADLR/megatron-lm!483
```
  70169453
- Data Preprocessing Optimizations · 7fc96111
  Vijay Korthikanti authored Nov 17, 2022
  
  7fc96111
11 Nov, 2022 2 commits
- Merge branch 'nmt-main' into 'main' · 1ad1e1b1
  Jared Casper authored Nov 10, 2022
```
Support for variable sequence lengths across micro-batches

See merge request ADLR/megatron-lm!472
```
  1ad1e1b1
- Support for variable sequence lengths across micro-batches · c3e688d3
  Vijay Korthikanti authored Nov 10, 2022
  
  c3e688d3
10 Nov, 2022 2 commits
- Merge branch 'yuya/vit_fix' into 'main' · b4297c6a
  Jared Casper authored Nov 10, 2022
```
ViT Backbone Tensor Shape Fix

See merge request ADLR/megatron-lm!479
```
  b4297c6a
- ViT Backbone Tensor Shape Fix · fabd3e4e
  Yu Yao authored Nov 10, 2022
  
  fabd3e4e
08 Nov, 2022 2 commits
- Merge branch 'core-fix' into 'main' · 1a26b291
  Jared Casper authored Nov 08, 2022
```
Fix merge error.

See merge request ADLR/megatron-lm!478
```
  1a26b291
- Fix merge error. · e0a12fe1
  Jared Casper authored Nov 08, 2022
  
  e0a12fe1
02 Nov, 2022 1 commit

Merge branch 'core' into 'main' · 42c40715

Jared Casper authored Nov 02, 2022

Move most of mpu functionality into a new "Megatron core"

See merge request ADLR/megatron-lm!462

42c40715