Commits · 4abd7ce275d063873b0d243ea99bb8bd84d5139a · OpenDAS / Megatron-LM

17 Apr, 2020 1 commit
- Refactor before merge request · 4abd7ce2
  Neel Kant authored Apr 17, 2020
  
  4abd7ce2
31 Mar, 2020 1 commit
- deprecated data_utils · 8600642e
  Mohammad authored Mar 31, 2020
  
  8600642e
30 Mar, 2020 1 commit
- Add debug statements · f1b2524b
  Neel Kant authored Mar 30, 2020
  
  f1b2524b
27 Mar, 2020 1 commit
- pretrain_bert_icy.py compiles and runs · 1dd51c0e
  Neel Kant authored Mar 27, 2020
  
  1dd51c0e
24 Mar, 2020 4 commits
- Correct some args and create pretrain_bert_ict.py · 21a916b1
  Neel Kant authored Mar 24, 2020
  
  21a916b1
- Complete __getitem__ for InverseClozeDataset · d2eabecb
  Neel Kant authored Mar 24, 2020
  
  d2eabecb
- Create class InverseClozeTask from bert_sentencepair_dataset and write get_input_and_context · 1c4e8955
  Neel Kant authored Mar 23, 2020
  
  1c4e8955
- Remove unused code · 57f4a8a9
  Neel Kant authored Mar 23, 2020
  
  57f4a8a9
08 Oct, 2019 1 commit
- created megatron package · b886b7bb
  Mohammad Shoeybi authored Oct 08, 2019
  
  b886b7bb
04 Oct, 2019 1 commit
- Updating public repo with latest changes. · a1d04b79
  Jared Casper authored Oct 04, 2019
  
  a1d04b79
30 Jul, 2019 1 commit

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e

23 Apr, 2019 1 commit

Faster dataloader merge () · 66719e97

Raul Puri authored Apr 23, 2019

* threaded tf_dl+presplit sentences+shuffled dataset with resume

* elaborate in readme

66719e97

27 Mar, 2019 1 commit
- initial commit · fb4cbdc2
  Raul Puri authored Mar 27, 2019
  
  fb4cbdc2