Commits · dfb907fe557c5fe8f46c2501b4a87ed4e1bd9c46 · OpenDAS / Megatron-LM

27 May, 2020 1 commit
- Correct CrossEntropyLoss · 0e8f4331
  Neel Kant authored May 27, 2020
  
  0e8f4331
26 May, 2020 1 commit
- Corrected realm example building, misc improvements for async concurrency · 2fd4ea6c
  Neel Kant authored May 25, 2020
  
  2fd4ea6c
24 May, 2020 1 commit
- Use Faiss GPU index and report retrieval utility · 8573ab35
  Neel Kant authored May 24, 2020
  
  8573ab35
19 May, 2020 1 commit
- Reorganize indexer. Things run up to saving model checkpoint and repeating · d4b00be0
  Neel Kant authored May 19, 2020
  
  d4b00be0
15 May, 2020 1 commit
- Able to run REALM with terrible index sync · 0f0f60aa
  Neel Kant authored May 15, 2020
  
  0f0f60aa
14 May, 2020 1 commit
- Add retrieval utility and autoresume for indexer · 2f7d666c
  Neel Kant authored May 14, 2020
  
  2f7d666c
12 May, 2020 4 commits
- faiss use_gpu · 6e256445
  Neel Kant authored May 12, 2020
  
  6e256445
- Debug and run salient span masking · c150c48b
  Neel Kant authored May 12, 2020
  
  c150c48b
- Add salient span masking, realm_dataset_utils and significant refactor · 451d1325
  Neel Kant authored May 11, 2020
  
  451d1325
- Update indexer.py · 5511c258
  Neel Kant authored May 11, 2020
  
  5511c258
07 May, 2020 3 commits
- Add primitive filesystem-based IPC for indexer and trainer jobs · 15d0d55b
  Neel Kant authored May 07, 2020
  
  15d0d55b
- Resolve internal merge conflict · 0f5e2809
  Neel Kant authored May 06, 2020
  
  0f5e2809
- Add REALMAnswerSpanModel and MLM features · f2094783
  Neel Kant authored May 06, 2020
  
  f2094783
05 May, 2020 6 commits
- more documentation for batch sampler · 5cb0c807
  Raul Puri authored May 05, 2020
  
  5cb0c807
- batch sampler interleave flag · 26d6aff4
  Raul Puri authored May 05, 2020
  
  26d6aff4
- Debug null document and exclude trivial candidate · c17d880c
  Neel Kant authored May 05, 2020
  
  c17d880c
- Add null block and exclude trivial block · efcee158
  Neel Kant authored May 05, 2020
  
  efcee158
- Refactor and add more REALM arguments · 730266ca
  Neel Kant authored May 05, 2020
  
  730266ca
- Move REALM to use FAISS · a2e64ad5
  Neel Kant authored May 04, 2020
  
  a2e64ad5
03 May, 2020 5 commits
- Complete refactor of RandProjectLSHIndex · 56e81e99
  Neel Kant authored May 03, 2020
  
  56e81e99
- Add realm_index · 642802e0
  Neel Kant authored May 03, 2020
  
  642802e0
- Move get_train_val... to dataset_utils · 16a64c41
  Neel Kant authored May 03, 2020
  
  16a64c41
- Refactor to build BlockData, FaissMIPSIndex, RandProjectLSHIndex · 183ad176
  Neel Kant authored May 03, 2020
  
  183ad176
- Move InverseClozeDataset to bert_dataset · 0104f910
  Neel Kant authored May 03, 2020
  
  0104f910
30 Apr, 2020 1 commit
- Whitening code · 9d225b44
  Neel Kant authored Apr 29, 2020
  
  9d225b44
29 Apr, 2020 1 commit
- Update and test misc functionality · 6c0a5bd8
  Neel Kant authored Apr 28, 2020
  
  6c0a5bd8
24 Apr, 2020 4 commits
- Add test_retriever.sh · 1eccfc94
  Neel Kant authored Apr 24, 2020
  
  1eccfc94
- Mostly debugged realm-mlm · d7022c72
  Neel Kant authored Apr 24, 2020
  
  d7022c72
- Revise dataset_type · 24034e03
  Neel Kant authored Apr 23, 2020
  
  24034e03
- Restructure BertDataset to help with RealmDataset · cf0100cf
  Neel Kant authored Apr 23, 2020
  
  cf0100cf
23 Apr, 2020 1 commit
- Debug test_retriever · ac79d374
  Neel Kant authored Apr 23, 2020
  
  ac79d374
21 Apr, 2020 1 commit
- Simplify batch and forward for ICT dataset and model · 5235ed87
  Neel Kant authored Apr 21, 2020
  
  5235ed87
20 Apr, 2020 1 commit
- Start creating REALMBertModel · ee2490d5
  Neel Kant authored Apr 20, 2020
  
  ee2490d5
17 Apr, 2020 1 commit
- Refactor before merge request · 4abd7ce2
  Neel Kant authored Apr 17, 2020
  
  4abd7ce2
16 Apr, 2020 6 commits
- changed licence 2019 to 2020 · 463d1257
  Mohammad authored Apr 16, 2020
  
  463d1257
- make minor modifications to licnese wording · 39af7956
  Mohammad authored Apr 16, 2020
  
  39af7956
- Build simple mlm examples · 8b1da95a
  Neel Kant authored Apr 16, 2020
  
  8b1da95a
- Better error reporting when a dataset doesn't exist. · f2779b18
  Jared Casper authored Apr 16, 2020
  
  f2779b18
- Check that the dataset helpers make runs successfully. · 9073c4bd
  Jared Casper authored Apr 16, 2020
  
  9073c4bd
- Include comprehensive block info when hashing · e6f2720d
  Neel Kant authored Apr 15, 2020
  
  e6f2720d