Commits · b70719933126662132af694428e7d008259c6ac1 · OpenDAS / Megatron-LM

03 Jan, 2023 1 commit
- Merge branch 'skyw/fix_zeroshot_eval_script' into 'main' · b7071993
  Jared Casper authored Jan 03, 2023
```
remove mpu dependency in zeroshot script

See merge request ADLR/megatron-lm!493
```
  b7071993
22 Dec, 2022 2 commits
- Merge branch 'transformer_engine_rebase' into 'main' · e1c334b0
  John Kamalu authored Dec 21, 2022
```
Transformer Engine Integration Rebase

See merge request ADLR/megatron-lm!487
```
  e1c334b0
- Transformer Engine Integration Rebase · 3499542e
  John Kamalu authored Dec 21, 2022
  
  3499542e
21 Dec, 2022 1 commit
- remove mpu dependency in zeroshot script · 8ed3887a
  Hao Wu authored Dec 21, 2022
  
  8ed3887a
29 Nov, 2022 3 commits
- Merge branch 'yuya/drop_path_fix' into 'main' · 52e63688
  Jared Casper authored Nov 29, 2022
```
Fix DropPath for hidden shape [s, b, h]

See merge request ADLR/megatron-lm!485
```
  52e63688
- Merge branch 'partition_fixes' into 'main' · b24f4adc
  Jared Casper authored Nov 29, 2022
```
bug fixes in partitioned data preprocessor

See merge request ADLR/megatron-lm!486
```
  b24f4adc
- bug fixes in partitioned data preprocessor · 84a43b13
  Mike Chrzanowski authored Nov 29, 2022
  
  84a43b13
24 Nov, 2022 2 commits
- Merge branch 'boxin/detoxify_lm_cr' into 'main' · 8ce8256f
  Boxin Wang authored Nov 23, 2022
```
Open sourcing lm detoxification code

See merge request ADLR/megatron-lm!471
```
  8ce8256f
- Open sourcing lm detoxification code · d48d95ab
  Boxin Wang authored Nov 23, 2022
  
  d48d95ab
22 Nov, 2022 1 commit
- Fix DropPath for hidden shape [s, b, h] · 6d45a903
  Yu Yao authored Nov 22, 2022
  
  6d45a903
17 Nov, 2022 2 commits
- Merge branch 'nmt-main' into 'main' · 70169453
  Mike Chrzanowski authored Nov 17, 2022
```
Data Preprocessing Optimizations

See merge request ADLR/megatron-lm!483
```
  70169453
- Data Preprocessing Optimizations · 7fc96111
  Vijay Korthikanti authored Nov 17, 2022
  
  7fc96111
11 Nov, 2022 2 commits
- Merge branch 'nmt-main' into 'main' · 1ad1e1b1
  Jared Casper authored Nov 10, 2022
```
Support for variable sequence lengths across micro-batches

See merge request ADLR/megatron-lm!472
```
  1ad1e1b1
- Support for variable sequence lengths across micro-batches · c3e688d3
  Vijay Korthikanti authored Nov 10, 2022
  
  c3e688d3
10 Nov, 2022 2 commits
- Merge branch 'yuya/vit_fix' into 'main' · b4297c6a
  Jared Casper authored Nov 10, 2022
```
ViT Backbone Tensor Shape Fix

See merge request ADLR/megatron-lm!479
```
  b4297c6a
- ViT Backbone Tensor Shape Fix · fabd3e4e
  Yu Yao authored Nov 10, 2022
  
  fabd3e4e
08 Nov, 2022 2 commits
- Merge branch 'core-fix' into 'main' · 1a26b291
  Jared Casper authored Nov 08, 2022
```
Fix merge error.

See merge request ADLR/megatron-lm!478
```
  1a26b291
- Fix merge error. · e0a12fe1
  Jared Casper authored Nov 08, 2022
  
  e0a12fe1
02 Nov, 2022 2 commits

Merge branch 'core' into 'main' · 42c40715

Jared Casper authored Nov 02, 2022

Move most of mpu functionality into a new "Megatron core"

See merge request ADLR/megatron-lm!462

42c40715

Merge branch 'check_prompts_is_list' into 'main' · fdc801ed

Jared Casper authored Nov 02, 2022

Sending in prompts with the wrong type hangs the server.  This is a check to make sure it's a list

See merge request ADLR/megatron-lm!473

fdc801ed

27 Oct, 2022 1 commit
- Sending in prompts with the wrong type hangs the server. This is a check to make sure it's a list · 2fdd54ec
  rprenger authored Oct 27, 2022
  
  2fdd54ec
20 Oct, 2022 2 commits
- Merge branch 'disable_newline_after_colon' into 'main' · f4a8b1d9
  Jared Casper authored Oct 19, 2022
```
Disable newline after colon

See merge request ADLR/megatron-lm!469
```
  f4a8b1d9
- Disable newline after colon · 544e2502
  Peng Xu authored Oct 19, 2022
  
  544e2502
14 Oct, 2022 5 commits
- Merge branch 'nmt-main' into 'main' · abf60f75
  Jared Casper authored Oct 14, 2022
```
inverse_square_root learning param schedule

See merge request ADLR/megatron-lm!466
```
  abf60f75
- Merge branch 'core-noop' into 'core' · d3a416cd
  Jared Casper authored Oct 14, 2022
```
Remove noop used to try to force scheduling and check for environment variable instead.

See merge request ADLR/megatron-lm!463
```
  d3a416cd
- Remove noop used to try to force scheduling and check for environment variable instead. · bdd97312
  Jared Casper authored Oct 14, 2022
  
  bdd97312
- inverse_square_root learning param schedule · dbed5e07
  Vijay Korthikanti authored Oct 14, 2022
  
  dbed5e07
- Merge branch 'core-merge-main' into 'core' · 5da3bb92
  Jared Casper authored Oct 13, 2022
```
Core merge main

See merge request ADLR/megatron-lm!464
```
  5da3bb92
13 Oct, 2022 3 commits
- Merge branch 'main' into core · 2a86fa20
  Jared Casper authored Oct 13, 2022
  
  2a86fa20
- Merge branch 'properTest' into 'core' · 8806ba73
  Jared Casper authored Oct 13, 2022
```
Adding proper test cases

See merge request ADLR/megatron-lm!460
```
  8806ba73
- Adding proper test cases · 8b94a160
  Shanmugam Ramasamy authored Oct 13, 2022
  
  8b94a160
11 Oct, 2022 3 commits
- Merge branch 'anmolg/validation_1' into 'main' · c7d57ff7
  Jared Casper authored Oct 11, 2022
```
Validation dataset update 1

See merge request ADLR/megatron-lm!455
```
  c7d57ff7
- Merge branch 'nmt-main' into 'main' · a95fda70
  Jared Casper authored Oct 11, 2022
```
different encoder/decoder num-layers support

See merge request ADLR/megatron-lm!453
```
  a95fda70
- address review comments · 69f3249f
  Vijay Korthikanti authored Oct 11, 2022
  
  69f3249f
10 Oct, 2022 1 commit
- removed assert for the case of evaluation only without training · 45cd4e0b
  Anmol Gupta authored Oct 10, 2022
  
  45cd4e0b
07 Oct, 2022 5 commits
- Code covearage · f8614670
  shanmugamr authored Oct 07, 2022
  
  f8614670
- Code covearage · c0329d8d
  shanmugamr authored Oct 07, 2022
  
  c0329d8d
- Code covearage · 2fd9ea1a
  shanmugamr authored Oct 07, 2022
  
  2fd9ea1a
- Changes' · 94dd94e1
  shanmugamr authored Oct 07, 2022
```
'
```
  94dd94e1
- Changes' · 11392f03
  shanmugamr authored Oct 07, 2022
```
'
```
  11392f03