Commits · 9238c57abdce596b99e94be08823ea71a87b0301 · OpenDAS / Megatron-LM

03 Apr, 2020 2 commits
- Remove commented out test code · 9238c57a
  Neel Kant authored Apr 03, 2020
  
  9238c57a
- Fix InverseClozeDataset behavior (with commented out test code) · ca6b6687
  Neel Kant authored Apr 03, 2020
  
  ca6b6687
01 Apr, 2020 1 commit
- Bugfix and remove unneeded script · 423c51b0
  Neel Kant authored Mar 31, 2020
  
  423c51b0
31 Mar, 2020 3 commits
- Make InverseClozeDataset more efficient · e949a5c5
  Neel Kant authored Mar 31, 2020
  
  e949a5c5
- Add while condition to InverseClozeDataset to protect against corner cases · 6e856fac
  Neel Kant authored Mar 31, 2020
  
  6e856fac
- Remove debug statements and correct dataloader · 6f56b909
  Neel Kant authored Mar 31, 2020
  
  6f56b909
30 Mar, 2020 1 commit
- Add debug statements · f1b2524b
  Neel Kant authored Mar 30, 2020
  
  f1b2524b
27 Mar, 2020 1 commit
- pretrain_bert_icy.py compiles and runs · 1dd51c0e
  Neel Kant authored Mar 27, 2020
  
  1dd51c0e
24 Mar, 2020 4 commits
- Correct some args and create pretrain_bert_ict.py · 21a916b1
  Neel Kant authored Mar 24, 2020
  
  21a916b1
- Complete __getitem__ for InverseClozeDataset · d2eabecb
  Neel Kant authored Mar 24, 2020
  
  d2eabecb
- Create class InverseClozeTask from bert_sentencepair_dataset and write get_input_and_context · 1c4e8955
  Neel Kant authored Mar 23, 2020
  
  1c4e8955
- Remove unused code · 57f4a8a9
  Neel Kant authored Mar 23, 2020
  
  57f4a8a9
08 Oct, 2019 1 commit
- created megatron package · b886b7bb
  Mohammad Shoeybi authored Oct 08, 2019
  
  b886b7bb
04 Oct, 2019 1 commit
- Updating public repo with latest changes. · a1d04b79
  Jared Casper authored Oct 04, 2019
  
  a1d04b79
30 Jul, 2019 1 commit

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e

23 Apr, 2019 1 commit

Faster dataloader merge () · 66719e97

Raul Puri authored Apr 23, 2019

* threaded tf_dl+presplit sentences+shuffled dataset with resume

* elaborate in readme

66719e97

27 Mar, 2019 1 commit
- initial commit · fb4cbdc2
  Raul Puri authored Mar 27, 2019
  
  fb4cbdc2