Commits · 6e256445461040eeb3cbfdb49725fa9ec8eaf35c · OpenDAS / Megatron-LM

12 May, 2020 7 commits
- faiss use_gpu · 6e256445
  Neel Kant authored May 12, 2020
  
  6e256445
- Merge branch 'master' into realm-mlm · 0c077a2c
  Neel Kant authored May 12, 2020
  
  0c077a2c
- Update faiss_test · 150f2384
  Neel Kant authored May 12, 2020
  
  150f2384
- Add indexer_utils · c9ca82bd
  Neel Kant authored May 12, 2020
  
  c9ca82bd
- Debug and run salient span masking · c150c48b
  Neel Kant authored May 12, 2020
  
  c150c48b
- Add salient span masking, realm_dataset_utils and significant refactor · 451d1325
  Neel Kant authored May 11, 2020
  
  451d1325
- Update indexer.py · 5511c258
  Neel Kant authored May 11, 2020
  
  5511c258
08 May, 2020 1 commit
- Merge branch 'master_params_sharing' into 'master' · e9eef962
  Raul Puri authored May 08, 2020
```
Parameters sharing

See merge request ADLR/megatron-lm!82
```
  e9eef962
07 May, 2020 3 commits
- Add primitive filesystem-based IPC for indexer and trainer jobs · 15d0d55b
  Neel Kant authored May 07, 2020
  
  15d0d55b
- Resolve internal merge conflict · 0f5e2809
  Neel Kant authored May 06, 2020
  
  0f5e2809
- Add REALMAnswerSpanModel and MLM features · f2094783
  Neel Kant authored May 06, 2020
  
  f2094783
06 May, 2020 6 commits
- addressed jareds comment · c9c69c1e
  mohammad authored May 06, 2020
  
  c9c69c1e
- Merge branch 'master' into master_params_sharing · fe1ea898
  mohammad authored May 05, 2020
  
  fe1ea898
- tested and seems to be working · b1ac9fd3
  mohammad authored May 05, 2020
  
  b1ac9fd3
- Merge branch 'batch_sampler_update' into 'master' · 3ee811be
  Mohammad Shoeybi authored May 05, 2020
```
batch sampler interleave flag

See merge request ADLR/megatron-lm!81
```
  3ee811be
- added parameters sharing · f257d0ee
  Mohammad authored May 05, 2020
  
  f257d0ee
- added parameters sharing · 80f90dcd
  Mohammad authored May 05, 2020
  
  80f90dcd
05 May, 2020 9 commits
- more documentation for batch sampler · 5cb0c807
  Raul Puri authored May 05, 2020
  
  5cb0c807
- batch sampler interleave flag · 26d6aff4
  Raul Puri authored May 05, 2020
  
  26d6aff4
- Merge branch 'no_cpu_allowed' into 'master' · ad299490
  Mohammad Shoeybi authored May 05, 2020
```
optionally allow no cpu

See merge request ADLR/megatron-lm!80
```
  ad299490
- Update initialize.py · f931b8a3
  Raul Puri authored May 05, 2020
  
  f931b8a3
- Debug null document and exclude trivial candidate · c17d880c
  Neel Kant authored May 05, 2020
  
  c17d880c
- Add null block and exclude trivial block · efcee158
  Neel Kant authored May 05, 2020
  
  efcee158
- Refactor and add more REALM arguments · 730266ca
  Neel Kant authored May 05, 2020
  
  730266ca
- Move REALM to use FAISS · a2e64ad5
  Neel Kant authored May 04, 2020
  
  a2e64ad5
- Add faiss_test.py · 29825734
  Neel Kant authored May 04, 2020
  
  29825734
04 May, 2020 1 commit
- optionally allow no cpu · 6106127c
  Raul Puri authored May 03, 2020
  
  6106127c
03 May, 2020 8 commits
- Complete refactor of RandProjectLSHIndex · 56e81e99
  Neel Kant authored May 03, 2020
  
  56e81e99
- Add realm_index · 642802e0
  Neel Kant authored May 03, 2020
  
  642802e0
- Move get_train_val... to dataset_utils · 16a64c41
  Neel Kant authored May 03, 2020
  
  16a64c41
- more for pretrain_realm · 59031aa7
  Neel Kant authored May 03, 2020
  
  59031aa7
- Correct arguments · 002cb170
  Neel Kant authored May 03, 2020
  
  002cb170
- Refactor to build BlockData, FaissMIPSIndex, RandProjectLSHIndex · 183ad176
  Neel Kant authored May 03, 2020
  
  183ad176
- Move InverseClozeDataset to bert_dataset · 0104f910
  Neel Kant authored May 03, 2020
  
  0104f910
- Corrected exact_mips_test · 1e01b3a2
  Neel Kant authored May 02, 2020
  
  1e01b3a2
30 Apr, 2020 5 commits
- Implement MIPS with FAISS · c1c958fa
  Neel Kant authored Apr 30, 2020
  
  c1c958fa
- Reconcile changes with head node · 56bd4804
  Neel Kant authored Apr 30, 2020
  
  56bd4804
- Misc mips-related improvements · 5952c558
  Neel Kant authored Apr 30, 2020
  
  5952c558
- Write MIPS tests in HashedIndex · 3f122ce9
  Neel Kant authored Apr 30, 2020
  
  3f122ce9
- Whitening code · 9d225b44
  Neel Kant authored Apr 29, 2020
  
  9d225b44