Commits · 002cb1700c6d5d8f160f07f8caa8bb69a914d765 · OpenDAS / Megatron-LM

29 Apr, 2020 1 commit
- Update and test misc functionality · 6c0a5bd8
  Neel Kant authored Apr 28, 2020
  
  6c0a5bd8
24 Apr, 2020 3 commits
- Add test_retriever.sh · 1eccfc94
  Neel Kant authored Apr 24, 2020
  
  1eccfc94
- Mostly debugged realm-mlm · d7022c72
  Neel Kant authored Apr 24, 2020
  
  d7022c72
- Revise REALMBertModel and REALMRetriever · f42b4d24
  Neel Kant authored Apr 23, 2020
  
  f42b4d24
23 Apr, 2020 1 commit
- Debug test_retriever · ac79d374
  Neel Kant authored Apr 23, 2020
  
  ac79d374
21 Apr, 2020 3 commits
- Debug hashed_index.main · 88637044
  Neel Kant authored Apr 21, 2020
  
  88637044
- Add REALMRetriever and some misc · 9a617f6c
  Neel Kant authored Apr 21, 2020
  
  9a617f6c
- Simplify batch and forward for ICT dataset and model · 5235ed87
  Neel Kant authored Apr 21, 2020
  
  5235ed87
20 Apr, 2020 2 commits
- Enhance hashed_index and more improvements elsewhere · 256eb6ed
  Neel Kant authored Apr 20, 2020
  
  256eb6ed
- Start creating REALMBertModel · ee2490d5
  Neel Kant authored Apr 20, 2020
  
  ee2490d5
17 Apr, 2020 1 commit
- Refactor before merge request · 4abd7ce2
  Neel Kant authored Apr 17, 2020
  
  4abd7ce2
16 Apr, 2020 2 commits
- changed licence 2019 to 2020 · 463d1257
  Mohammad authored Apr 16, 2020
  
  463d1257
- Build simple mlm examples · 8b1da95a
  Neel Kant authored Apr 16, 2020
  
  8b1da95a
15 Apr, 2020 1 commit
- added faster L2 grad clipping and new torch gelu · 3ea5491e
  Mohammad authored Apr 14, 2020
  
  3ea5491e
14 Apr, 2020 1 commit
- Lint whole repo · b7f1b050
  Neel Kant authored Apr 14, 2020
  
  b7f1b050
09 Apr, 2020 1 commit
- Qualitative test prep works · 360885ee
  Neel Kant authored Apr 09, 2020
  
  360885ee
08 Apr, 2020 1 commit
- Add ICT qualitative test script · 7504ef44
  Neel Kant authored Apr 08, 2020
  
  7504ef44
06 Apr, 2020 1 commit
- Fix ICTBertModel args · 2f6d2a3a
  Neel Kant authored Apr 05, 2020
  
  2f6d2a3a
03 Apr, 2020 2 commits
- Fix InverseClozeDataset behavior (with commented out test code) · ca6b6687
  Neel Kant authored Apr 03, 2020
  
  ca6b6687
- working on refactoring text generation · ce29d4d5
  Mohammad authored Apr 02, 2020
  
  ce29d4d5
31 Mar, 2020 2 commits
- Remove debug statements and correct dataloader · 6f56b909
  Neel Kant authored Mar 31, 2020
  
  6f56b909
- arguments in the model refactored · deffcb6a
  Mohammad authored Mar 31, 2020
  
  deffcb6a
30 Mar, 2020 1 commit
- Add debug statements · f1b2524b
  Neel Kant authored Mar 30, 2020
  
  f1b2524b
26 Mar, 2020 4 commits
- Complete definition of ICTBertModel · 371d2ea9
  Neel Kant authored Mar 26, 2020
  
  371d2ea9
- Reformat parts of BertModel · 9873a8da
  Neel Kant authored Mar 26, 2020
  
  9873a8da
- Create ICTBertModel and update model/.__init__.py · fd33e930
  Neel Kant authored Mar 26, 2020
  
  fd33e930
- Add ICT-related parameters to BertModel · bcb320ee
  Neel Kant authored Mar 26, 2020
  
  bcb320ee
10 Feb, 2020 1 commit
- Model parallel merger · 57c2060f
  Mohammad Shoeybi authored Feb 10, 2020
  
  57c2060f
14 Jan, 2020 1 commit
- added query-key layer scaling and softmax fp32 option · 691747b1
  Mohammad Shoeybi authored Jan 13, 2020
  
  691747b1
21 Nov, 2019 1 commit
- fixed padding issue · f6a6811f
  Mohammad Shoeybi authored Nov 20, 2019
  
  f6a6811f
29 Oct, 2019 1 commit
- Major refactoring, combining gpt2 and bert · 73af1290
  Mohammad Shoeybi authored Oct 29, 2019
  
  73af1290