Commits · e0a12fe1dcd27f26370b6bb61a31955e8f69f52b · OpenDAS / Megatron-LM

08 Nov, 2022 1 commit
- Fix merge error. · e0a12fe1
  Jared Casper authored Nov 08, 2022
  
  e0a12fe1
14 Oct, 2022 3 commits
- Merge branch 'core-noop' into 'core' · d3a416cd
  Jared Casper authored Oct 14, 2022
```
Remove noop used to try to force scheduling and check for environment variable instead.

See merge request ADLR/megatron-lm!463
```
  d3a416cd
- Remove noop used to try to force scheduling and check for environment variable instead. · bdd97312
  Jared Casper authored Oct 14, 2022
  
  bdd97312
- Merge branch 'core-merge-main' into 'core' · 5da3bb92
  Jared Casper authored Oct 13, 2022
```
Core merge main

See merge request ADLR/megatron-lm!464
```
  5da3bb92
13 Oct, 2022 3 commits
- Merge branch 'main' into core · 2a86fa20
  Jared Casper authored Oct 13, 2022
  
  2a86fa20
- Merge branch 'properTest' into 'core' · 8806ba73
  Jared Casper authored Oct 13, 2022
```
Adding proper test cases

See merge request ADLR/megatron-lm!460
```
  8806ba73
- Adding proper test cases · 8b94a160
  Shanmugam Ramasamy authored Oct 13, 2022
  
  8b94a160
11 Oct, 2022 3 commits
- Merge branch 'anmolg/validation_1' into 'main' · c7d57ff7
  Jared Casper authored Oct 11, 2022
```
Validation dataset update 1

See merge request ADLR/megatron-lm!455
```
  c7d57ff7
- Merge branch 'nmt-main' into 'main' · a95fda70
  Jared Casper authored Oct 11, 2022
```
different encoder/decoder num-layers support

See merge request ADLR/megatron-lm!453
```
  a95fda70
- address review comments · 69f3249f
  Vijay Korthikanti authored Oct 11, 2022
  
  69f3249f
10 Oct, 2022 1 commit
- removed assert for the case of evaluation only without training · 45cd4e0b
  Anmol Gupta authored Oct 10, 2022
  
  45cd4e0b
07 Oct, 2022 6 commits
- Code covearage · f8614670
  shanmugamr authored Oct 07, 2022
  
  f8614670
- Code covearage · c0329d8d
  shanmugamr authored Oct 07, 2022
  
  c0329d8d
- Code covearage · 2fd9ea1a
  shanmugamr authored Oct 07, 2022
  
  2fd9ea1a
- Changes' · 94dd94e1
  shanmugamr authored Oct 07, 2022
```
'
```
  94dd94e1
- Changes' · 11392f03
  shanmugamr authored Oct 07, 2022
```
'
```
  11392f03
- Adding some basic unit tests · 4ec95a2e
  shanmugamr authored Oct 06, 2022
  
  4ec95a2e
06 Oct, 2022 11 commits
- Adding some basic unit tests · e9f20007
  shanmugamr authored Oct 06, 2022
  
  e9f20007
- Adding some basic unit tests · 44c94f56
  shanmugamr authored Oct 06, 2022
  
  44c94f56
- Adding some basic unit tests · 74ee8c01
  shanmugamr authored Oct 06, 2022
  
  74ee8c01
- Adding some basic unit tests · 56934a2d
  shanmugamr authored Oct 06, 2022
  
  56934a2d
- Adding some basic unit tests · 423623cb
  shanmugamr authored Oct 06, 2022
  
  423623cb
- Adding some basic unit tests · 056fc7c9
  shanmugamr authored Oct 06, 2022
  
  056fc7c9
- Merge branch 'core' of ssh://gitlab-master.nvidia.com:12051/ADLR/megatron-lm into core · 136cf036
  shanmugamr authored Oct 06, 2022
  
  136cf036
- Adding some basic unit tests · b69e2195
  shanmugamr authored Oct 06, 2022
  
  b69e2195
- Merge branch 'changes_for_nemo' into 'core' · 6d417896
  Jared Casper authored Oct 05, 2022
```
Setter for pipeline parallel split rank, remove print

See merge request ADLR/megatron-lm!454
```
  6d417896
- Setter for pipeline parallel split rank, remove print · 6defe188
  Eric Harper authored Oct 05, 2022
  
  6defe188
- Merge branch 'fix_backward_no_pipeline' into 'main' · 96b7559d
  Jared Casper authored Oct 05, 2022
```
fixed the timer issue for the case with no pipelining

See merge request ADLR/megatron-lm!456
```
  96b7559d
05 Oct, 2022 3 commits
- fixed the timer issue for the case with no pipelining · 2514892c
  mshoeybi authored Oct 05, 2022
  
  2514892c
- support for separate dataset files for train, valid and test · 63e59949
  Anmol Gupta authored Oct 05, 2022
  
  63e59949
- Adding some basic unit tests · 6ab70f5c
  shanmugamr authored Oct 05, 2022
  
  6ab70f5c
04 Oct, 2022 3 commits
- different encoder/decoder num-layers support · cbf8250b
  Vijay Korthikanti authored Oct 03, 2022
  
  cbf8250b
- Code coverage setup · fb8c09eb
  shanmugamr authored Oct 03, 2022
  
  fb8c09eb
- Setting up code coverage · 05d731ab
  shanmugamr authored Oct 03, 2022
  
  05d731ab
03 Oct, 2022 2 commits
- Merge branch 'nmt-main' into 'main' · b9ae7ba5
  Jared Casper authored Oct 03, 2022
```
yttm + BytelevelBPE + setencepeice tokenizer support

See merge request ADLR/megatron-lm!437
```
  b9ae7ba5
- Merge branch 'main' into nmt-main · 41276b6c
  Vijay Korthikanti authored Oct 03, 2022
  
  41276b6c
30 Sep, 2022 2 commits
- Merge branch 'lmcafee/byte-buffer' into 'main' · fc7f4f03
  Jared Casper authored Sep 30, 2022
```
Perform distributed optimizer's all-gather in param dtype (instead of grad dtype)

See merge request ADLR/megatron-lm!448
```
  fc7f4f03
- Perform distributed optimizer's all-gather in param dtype (instead of grad dtype) · 57bfa7ca
  Lawrence McAfee authored Sep 30, 2022
  
  57bfa7ca
27 Sep, 2022 2 commits
- Support gradient accumulation fusion in fp16. · 07916bf2
  Jared Casper authored Sep 27, 2022
  
  07916bf2
- Error, not warn, if gradient_accumulation_fusion is requested but not available. · 2366716f
  Jared Casper authored Sep 27, 2022
  
  2366716f