Commits · ea81d62f3ef830c39c0203f2d40d4471b6fde29c · OpenDAS / Megatron-LM

18 Nov, 2020 1 commit
- Replace deprecated torch.norm with torch.linalg.norm. · 17035d6c
  Jared Casper authored Nov 17, 2020
  
  17035d6c
26 Jul, 2020 1 commit
- Complete fix for APEX absence in NeMo · aa0ee72e
  Boris Fomitchev authored Jul 25, 2020
  
  aa0ee72e
21 Apr, 2020 3 commits
- removed optimized l2 grad clipping · 0b6bdca6
  Mohammad authored Apr 21, 2020
  
  0b6bdca6
- fixed a bug in l2 grad clip · 4ff2c963
  Mohammad authored Apr 20, 2020
  
  4ff2c963
- fixed a bug in l2 grad clip · fb5b2b36
  Mohammad authored Apr 20, 2020
  
  fb5b2b36
16 Apr, 2020 1 commit
- changed licence 2019 to 2020 · 463d1257
  Mohammad authored Apr 16, 2020
  
  463d1257
15 Apr, 2020 1 commit
- added faster L2 grad clipping and new torch gelu · 3ea5491e
  Mohammad authored Apr 14, 2020
  
  3ea5491e
08 Oct, 2019 1 commit
- created megatron package · b886b7bb
  Mohammad Shoeybi authored Oct 08, 2019
  
  b886b7bb
30 Jul, 2019 1 commit

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e