Commits · 51204a4da7d32ca74033c8d357a1fe32dca59af6 · OpenDAS / Megatron-LM

31 May, 2020 1 commit
- Misc changes · 51204a4d
  Neel Kant authored May 30, 2020
  
  51204a4d
27 May, 2020 3 commits
- Correct indexer seq length · dfb907fe
  Neel Kant authored May 27, 2020
  
  dfb907fe
- Merge branch 'realm-mlm' of https://gitlab-master.nvidia.com/ADLR/megatron-lm into realm-mlm · ab5c4f92
  Neel Kant authored May 27, 2020
  
  ab5c4f92
- Correct CrossEntropyLoss · 0e8f4331
  Neel Kant authored May 27, 2020
  
  0e8f4331
26 May, 2020 1 commit
- Corrected realm example building, misc improvements for async concurrency · 2fd4ea6c
  Neel Kant authored May 25, 2020
  
  2fd4ea6c
24 May, 2020 3 commits
- Fix token alignment, add mpu checkpointing, misc training code · 8e22824e
  Neel Kant authored May 24, 2020
  
  8e22824e
- Use Faiss GPU index and report retrieval utility · 8573ab35
  Neel Kant authored May 24, 2020
  
  8573ab35
- Restructure Indexer classes · e59496bf
  Neel Kant authored May 24, 2020
  
  e59496bf
21 May, 2020 2 commits
- Fix autoresume by removing code from indexer · e0a1caba
  Neel Kant authored May 21, 2020
  
  e0a1caba
- Change sync variable to gloo backend · 05ea0cca
  Neel Kant authored May 21, 2020
  
  05ea0cca
20 May, 2020 1 commit
- Async works for total 8 GPU, indexer debug mode · a670b6c9
  Neel Kant authored May 19, 2020
  
  a670b6c9
19 May, 2020 3 commits
- Full cycle of communication complete. Also added BasicIndexBuilder · 5684f904
  Neel Kant authored May 19, 2020
  
  5684f904
- Reorganize indexer. Things run up to saving model checkpoint and repeating · d4b00be0
  Neel Kant authored May 19, 2020
  
  d4b00be0
- Indexer_async works in theory · e338e311
  Neel Kant authored May 18, 2020
  
  e338e311
18 May, 2020 1 commit
- Add indexer_async · edaf2aab
  Neel Kant authored May 18, 2020
  
  edaf2aab
15 May, 2020 1 commit
- Able to run REALM with terrible index sync · 0f0f60aa
  Neel Kant authored May 15, 2020
  
  0f0f60aa
14 May, 2020 2 commits
- Add retrieval utility and autoresume for indexer · 2f7d666c
  Neel Kant authored May 14, 2020
  
  2f7d666c
- Minor adjustments to fit QA codebase · 9b9b8e01
  Neel Kant authored May 14, 2020
  
  9b9b8e01
12 May, 2020 7 commits
- faiss use_gpu · 6e256445
  Neel Kant authored May 12, 2020
  
  6e256445
- Merge branch 'master' into realm-mlm · 0c077a2c
  Neel Kant authored May 12, 2020
  
  0c077a2c
- Update faiss_test · 150f2384
  Neel Kant authored May 12, 2020
  
  150f2384
- Add indexer_utils · c9ca82bd
  Neel Kant authored May 12, 2020
  
  c9ca82bd
- Debug and run salient span masking · c150c48b
  Neel Kant authored May 12, 2020
  
  c150c48b
- Add salient span masking, realm_dataset_utils and significant refactor · 451d1325
  Neel Kant authored May 11, 2020
  
  451d1325
- Update indexer.py · 5511c258
  Neel Kant authored May 11, 2020
  
  5511c258
08 May, 2020 1 commit
- Merge branch 'master_params_sharing' into 'master' · e9eef962
  Raul Puri authored May 08, 2020
```
Parameters sharing

See merge request ADLR/megatron-lm!82
```
  e9eef962
07 May, 2020 3 commits
- Add primitive filesystem-based IPC for indexer and trainer jobs · 15d0d55b
  Neel Kant authored May 07, 2020
  
  15d0d55b
- Resolve internal merge conflict · 0f5e2809
  Neel Kant authored May 06, 2020
  
  0f5e2809
- Add REALMAnswerSpanModel and MLM features · f2094783
  Neel Kant authored May 06, 2020
  
  f2094783
06 May, 2020 6 commits
- addressed jareds comment · c9c69c1e
  mohammad authored May 06, 2020
  
  c9c69c1e
- Merge branch 'master' into master_params_sharing · fe1ea898
  mohammad authored May 05, 2020
  
  fe1ea898
- tested and seems to be working · b1ac9fd3
  mohammad authored May 05, 2020
  
  b1ac9fd3
- Merge branch 'batch_sampler_update' into 'master' · 3ee811be
  Mohammad Shoeybi authored May 05, 2020
```
batch sampler interleave flag

See merge request ADLR/megatron-lm!81
```
  3ee811be
- added parameters sharing · f257d0ee
  Mohammad authored May 05, 2020
  
  f257d0ee
- added parameters sharing · 80f90dcd
  Mohammad authored May 05, 2020
  
  80f90dcd
05 May, 2020 5 commits
- more documentation for batch sampler · 5cb0c807
  Raul Puri authored May 05, 2020
  
  5cb0c807
- batch sampler interleave flag · 26d6aff4
  Raul Puri authored May 05, 2020
  
  26d6aff4
- Merge branch 'no_cpu_allowed' into 'master' · ad299490
  Mohammad Shoeybi authored May 05, 2020
```
optionally allow no cpu

See merge request ADLR/megatron-lm!80
```
  ad299490
- Update initialize.py · f931b8a3
  Raul Puri authored May 05, 2020
  
  f931b8a3
- Debug null document and exclude trivial candidate · c17d880c
  Neel Kant authored May 05, 2020
  
  c17d880c