Commits · 2096d35692cdda568965147005bc7a4b9267778b · OpenDAS / Megatron-LM

"examples/offline_inference/batch_llm_inference.py" did not exist on "cdda292058947cfd2fdb7fb0835fae30d77868d4"

05 Feb, 2021 2 commits
- Merge branch 'fused_kernel_cond' into 'main' · 2096d356
  Jared Casper authored Feb 05, 2021
```
conditioning fused kernels

See merge request ADLR/megatron-lm!228
```
  2096d356
- address review comments · 0cb36de2
  Vijay Korthikanti authored Feb 05, 2021
  
  0cb36de2
04 Feb, 2021 1 commit
- conditioning fused kernels · 4916bae6
  Vijay Korthikanti authored Feb 04, 2021
  
  4916bae6
02 Feb, 2021 2 commits
- Merge branch 'merge_bugfix' into 'main' · 872e38ea
  Mohammad Shoeybi authored Feb 02, 2021
```
Fix bug in merge_mp_partitions for handling recent checkpoints.

See merge request ADLR/megatron-lm!226
```
  872e38ea
- Fix bug in merge_mp_partitions for handling recent checkpoints. · 72105ef0
  Jared Casper authored Feb 02, 2021
  
  72105ef0
01 Feb, 2021 2 commits
- Merge branch 'preprocess_fix' into 'main' · c601d751
  Mohammad Shoeybi authored Feb 01, 2021
```
Handle empty documents in preprocess_data.

See merge request ADLR/megatron-lm!225
```
  c601d751
- Handle empty documents in preprocess_data. · 09d220cf
  Jared Casper authored Feb 01, 2021
  
  09d220cf
29 Jan, 2021 4 commits
- Merge branch 'ci' into 'main' · 1b8e2891
  Jared Casper authored Jan 29, 2021
```
Init CI tests with very basic import test.

See merge request ADLR/megatron-lm!224
```
  1b8e2891
- Init CI tests with very basic import test. · 2526c614
  Jared Casper authored Jan 29, 2021
  
  2526c614
- Merge branch 'tensorboard_queue_size_increase' into 'main' · f2a3a25c
  Jared Casper authored Jan 29, 2021
```
added option to change tensorboard queue size

See merge request ADLR/megatron-lm!223
```
  f2a3a25c
- added option to change tensorboard queue size · e9b90500
  mohammad authored Jan 29, 2021
  
  e9b90500
28 Jan, 2021 11 commits
- Merge branch 'logging_refactor' into 'main' · 0e5b64af
  Jared Casper authored Jan 28, 2021
```
added options for tensorboard logging

See merge request ADLR/megatron-lm!222
```
  0e5b64af
- changed validation loss name · 792a468d
  mohammad authored Jan 28, 2021
  
  792a468d
- added options for tensorboard logging · 3a26a168
  mohammad authored Jan 28, 2021
  
  3a26a168
- Merge branch 'ckpt_fix' into 'main' · 16db4a2c
  Mohammad Shoeybi authored Jan 28, 2021
```
Typo fix.

See merge request ADLR/megatron-lm!221
```
  16db4a2c
- Typo fix. · e1f574cd
  Jared Casper authored Jan 28, 2021
  
  e1f574cd
- Merge branch 'ckpt_merge' into 'main' · 36c2674c
  Mohammad Shoeybi authored Jan 28, 2021
```
Teach merge_mp_partitions how to write out a pipelined model.

See merge request ADLR/megatron-lm!218
```
  36c2674c
- Improve comments around layer regex replacement. · 98a5b9a0
  Jared Casper authored Jan 28, 2021
  
  98a5b9a0
- Merge branch 'vision_transformer' into 'main' · de722164
  Jared Casper authored Jan 28, 2021
```
license text for autoaugmentation

See merge request ADLR/megatron-lm!220
```
  de722164
- change to LICENSE file · dcea434a
  Vijay Korthikanti authored Jan 28, 2021
  
  dcea434a
- Merge branch 'ckpt_transpose' into 'main' · 4468f3e4
  Jared Casper authored Jan 28, 2021
```
Rework handling of older checkpoint's attention weight/bias ordering.

See merge request ADLR/megatron-lm!219
```
  4468f3e4
- license text for autoaugmentation · 54bb3046
  Vijay Korthikanti authored Jan 28, 2021
  
  54bb3046
27 Jan, 2021 10 commits
- Move rearranging query_key_value and key_value values in old checkpoints to... · 76960d7c
  Jared Casper authored Jan 27, 2021
```
Move rearranging query_key_value and key_value values in old checkpoints to when the checkpoint is loaded instead of runtime..
```
  76960d7c
- Teach merge_mp_partitions how to write out a pipelined model. · 7cabbe67
  Jared Casper authored Jan 27, 2021
  
  7cabbe67
- Merge branch 'gpt3_script_fix' into 'main' · c7444380
  Jared Casper authored Jan 27, 2021
```
added init method std to gpt3 example

See merge request ADLR/megatron-lm!217
```
  c7444380
- added init method std · a6bf1a04
  mshoeybi authored Jan 26, 2021
  
  a6bf1a04
- Merge branch 'log_grad_norm' into 'main' · 60704e72
  Jared Casper authored Jan 26, 2021
```
added grad and params norm to logging and tensorboard

See merge request ADLR/megatron-lm!214
```
  60704e72
- added flag so we dont calculate params norm all the time · 3dcbaec9
  mohammad authored Jan 26, 2021
  
  3dcbaec9
- Merge branch 'main' into log_grad_norm · 929c780c
  mohammad authored Jan 26, 2021
  
  929c780c
- Merge branch 'vit_einops_fix' into 'main' · 577ad7d3
  Jared Casper authored Jan 26, 2021
```
vit model does not get imported automatically anymore

See merge request ADLR/megatron-lm!216
```
  577ad7d3
- vit model does not get imported automatically · ab507293
  mohammad authored Jan 26, 2021
  
  ab507293
- merge conflict resolved · 286c4d97
  mohammad authored Jan 26, 2021
  
  286c4d97
26 Jan, 2021 8 commits
- Merge branch 'helpers_compilation' into 'main' · 1a92ce5c
  Jared Casper authored Jan 26, 2021
```
call helpers makefile every run so we recompile if the code has changed

See merge request ADLR/megatron-lm!215
```
  1a92ce5c
- Merge branch 'vision_transformer' into 'main' · 996aca68
  Jared Casper authored Jan 26, 2021
```
Vision transformer

See merge request ADLR/megatron-lm!204
```
  996aca68
- dataloader_type argument fix + randomsampler fix · 85589322
  Vijay Korthikanti authored Jan 25, 2021
  
  85589322
- added params norms · 57d1356e
  mohammad authored Jan 25, 2021
  
  57d1356e
- Merge branch 'main' into log_grad_norm · d31d7e49
  mohammad authored Jan 25, 2021
  
  d31d7e49
- call makefile every run so we recompile if the code has changed · f0232865
  mohammad authored Jan 25, 2021
  
  f0232865
- Adressing more review comments · e6c7b05e
  Vijay Korthikanti authored Jan 25, 2021
  
  e6c7b05e
- Merge branch 'main' into vision_transformer · da8dccd6
  Vijay Korthikanti authored Jan 25, 2021
  
  da8dccd6