Commits · 1dd51c0ef8bf9c81dbc1733f64f6ae0eb42af90b · OpenDAS / Megatron-LM

27 Mar, 2020 1 commit
- pretrain_bert_icy.py compiles and runs · 1dd51c0e
  Neel Kant authored Mar 27, 2020
  
  1dd51c0e
24 Mar, 2020 4 commits
- Correct some args and create pretrain_bert_ict.py · 21a916b1
  Neel Kant authored Mar 24, 2020
  
  21a916b1
- Complete __getitem__ for InverseClozeDataset · d2eabecb
  Neel Kant authored Mar 24, 2020
  
  d2eabecb
- Create class InverseClozeTask from bert_sentencepair_dataset and write get_input_and_context · 1c4e8955
  Neel Kant authored Mar 23, 2020
  
  1c4e8955
- Remove unused code · 57f4a8a9
  Neel Kant authored Mar 23, 2020
  
  57f4a8a9
08 Oct, 2019 1 commit
- created megatron package · b886b7bb
  Mohammad Shoeybi authored Oct 08, 2019
  
  b886b7bb
04 Oct, 2019 1 commit
- Updating public repo with latest changes. · a1d04b79
  Jared Casper authored Oct 04, 2019
  
  a1d04b79
30 Jul, 2019 1 commit

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e

23 Apr, 2019 1 commit

Faster dataloader merge () · 66719e97

Raul Puri authored Apr 23, 2019

* threaded tf_dl+presplit sentences+shuffled dataset with resume

* elaborate in readme

66719e97

27 Mar, 2019 1 commit
- initial commit · fb4cbdc2
  Raul Puri authored Mar 27, 2019
  
  fb4cbdc2