Commits · a2e64ad59bd82d015e7b51cd94956fab2fcf8ea0 · OpenDAS / Megatron-LM

03 May, 2020 1 commit
- Correct arguments · 002cb170
  Neel Kant authored May 03, 2020
  
  002cb170
30 Apr, 2020 1 commit
- Whitening code · 9d225b44
  Neel Kant authored Apr 29, 2020
  
  9d225b44
27 Apr, 2020 1 commit
- remoed abbreviation matching from argparser · cf595489
  Mohammad authored Apr 27, 2020
  
  cf595489
24 Apr, 2020 7 commits
- fixed args · 04aa357e
  Mohammad authored Apr 24, 2020
  
  04aa357e
- flushed printing · 26c5f12a
  Raul Puri authored Apr 24, 2020
  
  26c5f12a
- addressed printing · 954f0725
  Raul Puri authored Apr 24, 2020
  
  954f0725
- changed default override behavior · d28527d5
  Raul Puri authored Apr 24, 2020
  
  d28527d5
- added case wordpiece arguments · ef5b2f06
  Raul Puri authored Apr 24, 2020
  
  ef5b2f06
- Add test_retriever.sh · 1eccfc94
  Neel Kant authored Apr 24, 2020
  
  1eccfc94
- REALM arguments · 6f54f50f
  Neel Kant authored Apr 23, 2020
  
  6f54f50f
21 Apr, 2020 1 commit
- added option to ignore unknown input arguments · 5531663b
  Mohammad authored Apr 20, 2020
  
  5531663b
16 Apr, 2020 1 commit
- changed licence 2019 to 2020 · 463d1257
  Mohammad authored Apr 16, 2020
  
  463d1257
15 Apr, 2020 3 commits
- added faster L2 grad clipping and new torch gelu · 3ea5491e
  Mohammad authored Apr 14, 2020
  
  3ea5491e
- addressed neels comments · 8e8e4548
  Mohammad authored Apr 14, 2020
  
  8e8e4548
- made size arguments optional so they can be set from input function · 368ad0d3
  Mohammad authored Apr 14, 2020
  
  368ad0d3
14 Apr, 2020 1 commit
- Lint whole repo · b7f1b050
  Neel Kant authored Apr 14, 2020
  
  b7f1b050
03 Apr, 2020 2 commits
- code runs · 752eeae3
  Mohammad authored Apr 02, 2020
  
  752eeae3
- working on refactoring text generation · ce29d4d5
  Mohammad authored Apr 02, 2020
  
  ce29d4d5
02 Apr, 2020 2 commits
- some changes to args · 2bd6196c
  Mohammad authored Apr 02, 2020
  
  2bd6196c
- refactored evaluate_gpt2 · 8fae1cdd
  Mohammad authored Apr 01, 2020
  
  8fae1cdd
31 Mar, 2020 1 commit
- arguments in the model refactored · deffcb6a
  Mohammad authored Mar 31, 2020
  
  deffcb6a
30 Mar, 2020 2 commits
- both bert and gpt2 tested and working · 1788c910
  Mohammad authored Mar 29, 2020
  
  1788c910
- added gpt2 tokenizer · 0e5dfd7f
  Mohammad authored Mar 29, 2020
  
  0e5dfd7f
29 Mar, 2020 1 commit
- refactored training · 27e14f82
  Mohammad authored Mar 28, 2020
  
  27e14f82
28 Mar, 2020 3 commits
- working on utils · 5050203f
  Mohammad authored Mar 28, 2020
  
  5050203f
- arguments.py refactored · 94e2ca57
  Mohammad authored Mar 27, 2020
  
  94e2ca57
- added initialize megatron · a9e19f8e
  Mohammad authored Mar 27, 2020
  
  a9e19f8e
27 Mar, 2020 2 commits
- added global variables · 83aa9219
  Mohammad authored Mar 27, 2020
  
  83aa9219
- working on bert · 599e959a
  Mohammad authored Mar 26, 2020
  
  599e959a
26 Mar, 2020 1 commit
- working on args · 1446bb64
  Mohammad authored Mar 26, 2020
  
  1446bb64
24 Mar, 2020 1 commit
- BERT downstream tasks: RACE, MNLI, QQP · 90ef2e28
  Mohammad Shoeybi authored Mar 23, 2020
  
  90ef2e28
10 Feb, 2020 1 commit
- Model parallel merger · 57c2060f
  Mohammad Shoeybi authored Feb 10, 2020
  
  57c2060f
14 Jan, 2020 1 commit
- added query-key layer scaling and softmax fp32 option · 691747b1
  Mohammad Shoeybi authored Jan 13, 2020
  
  691747b1
27 Dec, 2019 1 commit
- checked and bert, gpt, and albert albert run · f86bb671
  Mohammad Shoeybi authored Dec 26, 2019
  
  f86bb671
19 Nov, 2019 1 commit
- Plumbing for new albert dataset, including mods to arguments for data loaders. · 1a1cfcff
  Jared Casper authored Nov 18, 2019
  
  1a1cfcff
04 Oct, 2019 1 commit
- Updating public repo with latest changes. · a1d04b79
  Jared Casper authored Oct 04, 2019
  
  a1d04b79
30 Jul, 2019 1 commit

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e

23 Apr, 2019 1 commit

Faster dataloader merge () · 66719e97

Raul Puri authored Apr 23, 2019

* threaded tf_dl+presplit sentences+shuffled dataset with resume

* elaborate in readme

66719e97

27 Mar, 2019 1 commit
- initial commit · fb4cbdc2
  Raul Puri authored Mar 27, 2019
  
  fb4cbdc2