Commits · d805e1a014ebdaa6a8cb09714d6a4ffad785c8f0 · OpenDAS / Megatron-LM

20 Apr, 2020 3 commits
- Move links to download checkpoints section · b46e28bd
  Steven Steinke authored Apr 20, 2020
  
  b46e28bd
- Links to vocab in Data Preprocessing; added "WordPiece" to description · 8e4cb2a6
  Steven Steinke authored Apr 20, 2020
  
  8e4cb2a6
- Links to vocabs and merge table in Data Preprocessing · bdc3d5ba
  Steven Steinke authored Apr 20, 2020
  
  bdc3d5ba
16 Apr, 2020 9 commits
- remove wikitext comment · 7ec42d95
  Steven Steinke authored Apr 16, 2020
  
  7ec42d95
- RACE explained · 4f770782
  Steven Steinke authored Apr 16, 2020
  
  4f770782
- Update README.md · d976f011
  Steven Steinke authored Apr 16, 2020
  
  d976f011
- Fixed minor inconsistencies in scripts, added distributed comment · 2e0b3fca
  Steven Steinke authored Apr 16, 2020
  
  2e0b3fca
- looks great · 3df23c72
  Mohammad authored Apr 16, 2020
  
  3df23c72
- latest · 0d8f1243
  Mohammad authored Apr 16, 2020
  
  0d8f1243
- updated scripts · ca19a8b5
  Mohammad authored Apr 16, 2020
  
  ca19a8b5
- made monir changes to the first two paras · fe40745e
  Mohammad authored Apr 16, 2020
  
  fe40745e
- moved steves branch · 78cb1781
  Mohammad authored Apr 16, 2020
  
  78cb1781
30 Jul, 2019 1 commit

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e

23 Apr, 2019 1 commit

Faster dataloader merge () · 66719e97

Raul Puri authored Apr 23, 2019

* threaded tf_dl+presplit sentences+shuffled dataset with resume

* elaborate in readme

66719e97

27 Mar, 2019 1 commit
- initial commit · fb4cbdc2
  Raul Puri authored Mar 27, 2019
  
  fb4cbdc2