Commits · 2fd4ea6c05dde3df5bd831febe44cde1dc3193f6 · OpenDAS / Megatron-LM

26 May, 2020 1 commit
- Corrected realm example building, misc improvements for async concurrency · 2fd4ea6c
  Neel Kant authored May 25, 2020
  
  2fd4ea6c
24 May, 2020 1 commit
- Use Faiss GPU index and report retrieval utility · 8573ab35
  Neel Kant authored May 24, 2020
  
  8573ab35
20 May, 2020 1 commit
- Async works for total 8 GPU, indexer debug mode · a670b6c9
  Neel Kant authored May 19, 2020
  
  a670b6c9
19 May, 2020 1 commit
- Reorganize indexer. Things run up to saving model checkpoint and repeating · d4b00be0
  Neel Kant authored May 19, 2020
  
  d4b00be0
15 May, 2020 1 commit
- Able to run REALM with terrible index sync · 0f0f60aa
  Neel Kant authored May 15, 2020
  
  0f0f60aa
14 May, 2020 1 commit
- Add retrieval utility and autoresume for indexer · 2f7d666c
  Neel Kant authored May 14, 2020
  
  2f7d666c
12 May, 2020 1 commit
- Debug and run salient span masking · c150c48b
  Neel Kant authored May 12, 2020
  
  c150c48b
07 May, 2020 2 commits
- Add primitive filesystem-based IPC for indexer and trainer jobs · 15d0d55b
  Neel Kant authored May 07, 2020
  
  15d0d55b
- Add REALMAnswerSpanModel and MLM features · f2094783
  Neel Kant authored May 06, 2020
  
  f2094783
05 May, 2020 3 commits
- Add null block and exclude trivial block · efcee158
  Neel Kant authored May 05, 2020
  
  efcee158
- Refactor and add more REALM arguments · 730266ca
  Neel Kant authored May 05, 2020
  
  730266ca
- Move REALM to use FAISS · a2e64ad5
  Neel Kant authored May 04, 2020
  
  a2e64ad5
03 May, 2020 3 commits
- Move get_train_val... to dataset_utils · 16a64c41
  Neel Kant authored May 03, 2020
  
  16a64c41
- more for pretrain_realm · 59031aa7
  Neel Kant authored May 03, 2020
  
  59031aa7
- Refactor to build BlockData, FaissMIPSIndex, RandProjectLSHIndex · 183ad176
  Neel Kant authored May 03, 2020
  
  183ad176
29 Apr, 2020 1 commit
- Update and test misc functionality · 6c0a5bd8
  Neel Kant authored Apr 28, 2020
  
  6c0a5bd8
24 Apr, 2020 3 commits
- Mostly debugged realm-mlm · d7022c72
  Neel Kant authored Apr 24, 2020
  
  d7022c72
- Write pretrain_realm.py and misc dataset_type left from earlier · f7f730e1
  Neel Kant authored Apr 23, 2020
  
  f7f730e1
- Revise dataset_type · 24034e03
  Neel Kant authored Apr 23, 2020
  
  24034e03
20 Apr, 2020 2 commits
- Enhance hashed_index and more improvements elsewhere · 256eb6ed
  Neel Kant authored Apr 20, 2020
  
  256eb6ed
- Start creating REALMBertModel · ee2490d5
  Neel Kant authored Apr 20, 2020
  
  ee2490d5
17 Apr, 2020 1 commit
- Refactor before merge request · 4abd7ce2
  Neel Kant authored Apr 17, 2020
  
  4abd7ce2
15 Apr, 2020 2 commits
- Debug hash dump · 662dc982
  Neel Kant authored Apr 15, 2020
  
  662dc982
- Implement reformer hashing scheme · 81c71789
  Neel Kant authored Apr 15, 2020
  
  81c71789
14 Apr, 2020 1 commit
- Re-adjust dataloader properties · 064a6881
  Neel Kant authored Apr 13, 2020
  
  064a6881
07 Apr, 2020 1 commit
- Fix issue with validation dataloader · 064bdc46
  Neel Kant authored Apr 07, 2020
  
  064bdc46
03 Apr, 2020 2 commits
- Implement InverseClozeDataset with IndexedDataset · 4558e42f
  Neel Kant authored Apr 03, 2020
  
  4558e42f
- Fix InverseClozeDataset behavior (with commented out test code) · ca6b6687
  Neel Kant authored Apr 03, 2020
  
  ca6b6687
31 Mar, 2020 1 commit
- Remove debug statements and correct dataloader · 6f56b909
  Neel Kant authored Mar 31, 2020
  
  6f56b909
30 Mar, 2020 1 commit
- Add debug statements · f1b2524b
  Neel Kant authored Mar 30, 2020
  
  f1b2524b
27 Mar, 2020 1 commit
- pretrain_bert_icy.py compiles and runs · 1dd51c0e
  Neel Kant authored Mar 27, 2020
  
  1dd51c0e
26 Mar, 2020 1 commit
- Modify pretrain_bert_ict.py to work with ICTBertModel · b1efc33d
  Neel Kant authored Mar 26, 2020
  
  b1efc33d
24 Mar, 2020 1 commit
- Correct some args and create pretrain_bert_ict.py · 21a916b1
  Neel Kant authored Mar 24, 2020
  
  21a916b1
17 Mar, 2020 2 commits
- moved albert to bert · 09e05c6f
  Mohammad Shoeybi authored Mar 16, 2020
  
  09e05c6f
- moved pretrain albert to pretrain bert · 3e4e1ab2
  Mohammad Shoeybi authored Mar 16, 2020
  
  3e4e1ab2
14 Jan, 2020 1 commit
- added query-key layer scaling and softmax fp32 option · 691747b1
  Mohammad Shoeybi authored Jan 13, 2020
  
  691747b1
21 Nov, 2019 1 commit
- fixed padding issue · f6a6811f
  Mohammad Shoeybi authored Nov 20, 2019
  
  f6a6811f
19 Nov, 2019 1 commit
- Plumbing for new albert dataset, including mods to arguments for data loaders. · 1a1cfcff
  Jared Casper authored Nov 18, 2019
  
  1a1cfcff
31 Oct, 2019 1 commit
- refacotred for code reuse · 34be7dd3
  Mohammad Shoeybi authored Oct 30, 2019
  
  34be7dd3
29 Oct, 2019 1 commit
- Major refactoring, combining gpt2 and bert · 73af1290
  Mohammad Shoeybi authored Oct 29, 2019
  
  73af1290