Commits · 54282071dc6411aaa890eca2cf1000faecda2893 · OpenDAS / Megatron-LM

09 Oct, 2020 1 commit
- support for different query key sequence lengths · d763f54a
  Vijay Korthikanti authored Oct 08, 2020
  
  d763f54a
30 Sep, 2020 1 commit
- checkpoint versioning · a8d47812
  Vijay Korthikanti authored Sep 29, 2020
  
  a8d47812
29 Sep, 2020 2 commits
- bug fix · 7d4ad51e
  Vijay Korthikanti authored Sep 29, 2020
  
  7d4ad51e
- support for old checkpoint format · 37ae6646
  Vijay Korthikanti authored Sep 28, 2020
  
  37ae6646
18 Sep, 2020 1 commit
- scaling-generalized masking-softmax fusion kernel · d73def35
  root authored Sep 18, 2020
  
  d73def35
11 Sep, 2020 1 commit
- Various speed optimizations. · 51a2e6b0
  Vijay Korthikanti authored Sep 11, 2020
  
  51a2e6b0
02 Sep, 2020 1 commit
- added splitting checkpointed activations · d6c4248b
  mohammad authored Sep 02, 2020
  
  d6c4248b
26 Jul, 2020 1 commit
- Complete fix for APEX absence in NeMo · aa0ee72e
  Boris Fomitchev authored Jul 25, 2020
  
  aa0ee72e
24 Jul, 2020 2 commits
- Fixed APEX test · 8f0af7cd
  Boris Fomitchev authored Jul 24, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  8f0af7cd
- Warning added · b04eb0a2
  Boris Fomitchev authored Jul 23, 2020
  
  b04eb0a2
22 Jul, 2020 1 commit
- Initialization fixes: allowing simple case like pytest pass, also making apex optional · 9026b86d
  Boris Fomitchev authored Jul 22, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  9026b86d
06 May, 2020 4 commits
- addressed jareds comment · c9c69c1e
  mohammad authored May 06, 2020
  
  c9c69c1e
- tested and seems to be working · b1ac9fd3
  mohammad authored May 05, 2020
  
  b1ac9fd3
- added parameters sharing · f257d0ee
  Mohammad authored May 05, 2020
  
  f257d0ee
- added parameters sharing · 80f90dcd
  Mohammad authored May 05, 2020
  
  80f90dcd
16 Apr, 2020 1 commit
- changed licence 2019 to 2020 · 463d1257
  Mohammad authored Apr 16, 2020
  
  463d1257
14 Apr, 2020 1 commit
- Lint whole repo · b7f1b050
  Neel Kant authored Apr 14, 2020
  
  b7f1b050
10 Apr, 2020 1 commit
- fp32 fixes · 5f174c07
  Mohammad authored Apr 10, 2020
  
  5f174c07
31 Mar, 2020 1 commit
- arguments in the model refactored · deffcb6a
  Mohammad authored Mar 31, 2020
  
  deffcb6a
10 Feb, 2020 1 commit
- Model parallel merger · 57c2060f
  Mohammad Shoeybi authored Feb 10, 2020
  
  57c2060f
14 Jan, 2020 2 commits
- added query-key layer scaling and softmax fp32 option · 6c2d0337
  Mohammad Shoeybi authored Jan 13, 2020
  
  6c2d0337
- added query-key layer scaling and softmax fp32 option · 691747b1
  Mohammad Shoeybi authored Jan 13, 2020
  
  691747b1
29 Oct, 2019 1 commit
- Major refactoring, combining gpt2 and bert · 73af1290
  Mohammad Shoeybi authored Oct 29, 2019
  
  73af1290