Commits · 7bd25e261c20c5cfb3edca90b074ca5b5d3d15ae · OpenDAS / Megatron-LM

06 Apr, 2023 4 commits
- Merge branch 'next-best-lm/merge-rope-main' into 'main' · 7bd25e26
  Jared Casper authored Apr 05, 2023
```
merging rope to main

See merge request ADLR/megatron-lm!556
```
  7bd25e26
- Merge branch 'main' into next-best-lm/merge-rope-main · 74bd02ec
  Jared Casper authored Apr 05, 2023
  
  74bd02ec
- Merge branch 'activations-bias' into 'main' · f6d36d03
  Jared Casper authored Apr 05, 2023
```
Add swiglu and squared relu activations and ability to disable bias.

See merge request ADLR/megatron-lm!553
```
  f6d36d03
- Merge branch 'bugFix' into 'main' · 22f054d8
  Shanmugam Ramasamy authored Apr 05, 2023
```
Update .gitlab-ci.yml

See merge request ADLR/megatron-lm!560
```
  22f054d8
05 Apr, 2023 1 commit
- Update .gitlab-ci.yml · 939383ae
  Shanmugam Ramasamy authored Apr 05, 2023
  
  939383ae
04 Apr, 2023 3 commits
- Merge branch 'better-Output' into 'main' · 58020503
  Shanmugam Ramasamy authored Apr 04, 2023
```
Better output

See merge request ADLR/megatron-lm!559
```
  58020503
- Better output · 2221d882
  Shanmugam Ramasamy authored Apr 04, 2023
  
  2221d882
- removed self_attention_pos_emb · e1f1aa06
  Mostofa Patwary authored Apr 04, 2023
  
  e1f1aa06
03 Apr, 2023 4 commits
- addressing more comments · 5b7736ca
  Mostofa Patwary authored Apr 03, 2023
  
  5b7736ca
- addressing more comments · 07ffa1b7
  Mostofa Patwary authored Apr 03, 2023
  
  07ffa1b7
- addressed the comments · df521589
  Mostofa Patwary authored Apr 03, 2023
  
  df521589
- Addressing comments. · 420eec74
  Jared Casper authored Apr 03, 2023
  
  420eec74
01 Apr, 2023 3 commits
- Add swiglu and squared relu activations and ability to disable bias. · 2cc3dac7
  Jared Casper authored Apr 01, 2023
  
  2cc3dac7
- Merge branch 'core-pipeline-fix' into 'main' · fdd34a82
  Jared Casper authored Apr 01, 2023
```
Fix bug in core pipeline schedule

See merge request ADLR/megatron-lm!552
```
  fdd34a82
- Fix bug in core pipeline schedule · ff7b28f4
  Jared Casper authored Apr 01, 2023
  
  ff7b28f4
31 Mar, 2023 3 commits
- merging rope to main · 1e0e555c
  Mostofa Patwary authored Mar 31, 2023
  
  1e0e555c
- Merge branch 'activation-checkpoint-fix' into 'main' · 2c493fb3
  Jared Casper authored Mar 31, 2023
```
fix bug in uniform activation recompute

See merge request ADLR/megatron-lm!551
```
  2c493fb3
- fix bug in uniform activation recompute · fc2c81d3
  Jared Casper authored Mar 31, 2023
  
  fc2c81d3
27 Mar, 2023 2 commits
- Merge branch 'maanug/print-logdir' into 'main' · 035cae2e
  Maanu Grover authored Mar 27, 2023
```
Print result logs directory if Pytest fails

See merge request ADLR/megatron-lm!549
```
  035cae2e
- Print result logs directory if Pytest fails · d86299b0
  Maanu Grover authored Mar 27, 2023
  
  d86299b0
23 Mar, 2023 6 commits
- Merge branch 'core-pipeline' into 'main' · edca71da
  Jared Casper authored Mar 23, 2023
```
Move pipeline parallel functionality into core with associated changes.

See merge request ADLR/megatron-lm!499
```
  edca71da
- Move pipeline parallel functionality into core with associated changes. · 3c92fa93
  Jared Casper authored Mar 23, 2023
  
  3c92fa93
- Merge branch 'maanug/unit-tests-rules' into 'main' · 0b44909c
  Jared Casper authored Mar 22, 2023
```
Add rules for unit tests

See merge request ADLR/megatron-lm!545
```
  0b44909c
- Add rules for unit tests · d7d7591d
  Maanu Grover authored Mar 22, 2023
  
  d7d7591d
- Merge branch 'mausin/contiguous' into 'main' · a0b8ab23
  Jared Casper authored Mar 22, 2023
```
Add contiguous to grad_output in layers.py

See merge request ADLR/megatron-lm!542
```
  a0b8ab23
- Add contiguous to grad_output in layers.py · 09c2f6e4
  Markel Ausin authored Mar 22, 2023
  
  09c2f6e4
22 Mar, 2023 2 commits
- Merge branch 'BugFix' into 'main' · 5b78040e
  Jared Casper authored Mar 22, 2023
```
Update .gitlab-ci.yml

See merge request ADLR/megatron-lm!544
```
  5b78040e
- Update .gitlab-ci.yml · 7d1d560c
  Shanmugam Ramasamy authored Mar 22, 2023
  
  7d1d560c
16 Mar, 2023 4 commits
- Merge branch 'merge_req' into 'main' · b7f3c263
  Jared Casper authored Mar 16, 2023
```
Update .gitlab-ci.yml

See merge request ADLR/megatron-lm!540
```
  b7f3c263
- Update .gitlab-ci.yml · 6289787b
  Shanmugam Ramasamy authored Mar 16, 2023
  
  6289787b
- Merge branch 'UpdateTests' into 'main' · 7aceba87
  Shanmugam Ramasamy authored Mar 16, 2023
```
Update .gitlab-ci.yml

See merge request ADLR/megatron-lm!537
```
  7aceba87
- Update .gitlab-ci.yml · 9eb04e96
  Shanmugam Ramasamy authored Mar 16, 2023
  
  9eb04e96
14 Mar, 2023 2 commits
- Merge branch 'bugFixRestarting' into 'main' · 21c19e81
  Shanmugam Ramasamy authored Mar 14, 2023
```
Update .gitlab-ci.yml to support restarting pipeline

See merge request ADLR/megatron-lm!534
```
  21c19e81
- Update .gitlab-ci.yml to support restarting pipeline · 89a9f399
  Shanmugam Ramasamy authored Mar 14, 2023
  
  89a9f399
09 Mar, 2023 2 commits
- Merge branch 'maanug/gpt-text-gen' into 'main' · 636da044
  Jared Casper authored Mar 09, 2023
```
Fix GPT text generation

See merge request ADLR/megatron-lm!528
```
  636da044
- Fix GPT text generation · 3c760180
  Maanu Grover authored Mar 09, 2023
  
  3c760180
08 Mar, 2023 2 commits
- Merge branch 'citest' into 'main' · f5cf2e42
  Jared Casper authored Mar 08, 2023
```
Testing infrastructure for Megatron core

See merge request ADLR/megatron-lm!514
```
  f5cf2e42
- Testing infrastructure for Megatron core · 8e6fa622
  Shanmugam Ramasamy authored Mar 08, 2023
  
  8e6fa622
22 Feb, 2023 2 commits
- Merge branch 'maanug/readme-pretraining' into 'main' · 95f872f5
  Jared Casper authored Feb 21, 2023
```
Pretraining README update

See merge request ADLR/megatron-lm!512
```
  95f872f5
- Pretraining README update · 5ecd52a4
  Maanu Grover authored Feb 21, 2023
  
  5ecd52a4