Commits · c20f4d48f04bf994bcbac8c178bbafc7829e421d · OpenDAS / Megatron-LM

04 Jul, 2020 1 commit
- small fix for CheckpointFunction's backward() method when sone args may be NoneType · 4ee0537a
  Devendra Singh Sachan authored Jul 04, 2020
  
  4ee0537a
21 Apr, 2020 3 commits
- removed optimized l2 grad clipping · 0b6bdca6
  Mohammad authored Apr 21, 2020
  
  0b6bdca6
- fixed a bug in l2 grad clip · 4ff2c963
  Mohammad authored Apr 20, 2020
  
  4ff2c963
- fixed a bug in l2 grad clip · fb5b2b36
  Mohammad authored Apr 20, 2020
  
  fb5b2b36
16 Apr, 2020 1 commit
- changed licence 2019 to 2020 · 463d1257
  Mohammad authored Apr 16, 2020
  
  463d1257
15 Apr, 2020 1 commit
- added faster L2 grad clipping and new torch gelu · 3ea5491e
  Mohammad authored Apr 14, 2020
  
  3ea5491e
14 Apr, 2020 1 commit
- Lint whole repo · b7f1b050
  Neel Kant authored Apr 14, 2020
  
  b7f1b050
11 Mar, 2020 1 commit
- memory optimization in mpu cross entropy · 57064fd6
  Mohammad Shoeybi authored Mar 10, 2020
  
  57064fd6
10 Feb, 2020 1 commit
- Model parallel merger · 57c2060f
  Mohammad Shoeybi authored Feb 10, 2020
  
  57c2060f
29 Oct, 2019 1 commit
- Major refactoring, combining gpt2 and bert · 73af1290
  Mohammad Shoeybi authored Oct 29, 2019
  
  73af1290
08 Oct, 2019 1 commit
- created megatron package · b886b7bb
  Mohammad Shoeybi authored Oct 08, 2019
  
  b886b7bb