Commits · 51204a4da7d32ca74033c8d357a1fe32dca59af6 · OpenDAS / Megatron-LM

31 May, 2020 1 commit
- Misc changes · 51204a4d
  Neel Kant authored May 30, 2020
  
  51204a4d
27 May, 2020 1 commit
- Correct CrossEntropyLoss · 0e8f4331
  Neel Kant authored May 27, 2020
  
  0e8f4331
26 May, 2020 1 commit
- Corrected realm example building, misc improvements for async concurrency · 2fd4ea6c
  Neel Kant authored May 25, 2020
  
  2fd4ea6c
24 May, 2020 1 commit
- Fix token alignment, add mpu checkpointing, misc training code · 8e22824e
  Neel Kant authored May 24, 2020
  
  8e22824e
20 May, 2020 1 commit
- Async works for total 8 GPU, indexer debug mode · a670b6c9
  Neel Kant authored May 19, 2020
  
  a670b6c9
19 May, 2020 1 commit
- Full cycle of communication complete. Also added BasicIndexBuilder · 5684f904
  Neel Kant authored May 19, 2020
  
  5684f904
14 May, 2020 2 commits
- Add retrieval utility and autoresume for indexer · 2f7d666c
  Neel Kant authored May 14, 2020
  
  2f7d666c
- Minor adjustments to fit QA codebase · 9b9b8e01
  Neel Kant authored May 14, 2020
  
  9b9b8e01
12 May, 2020 1 commit
- faiss use_gpu · 6e256445
  Neel Kant authored May 12, 2020
  
  6e256445
07 May, 2020 2 commits
- Add primitive filesystem-based IPC for indexer and trainer jobs · 15d0d55b
  Neel Kant authored May 07, 2020
  
  15d0d55b
- Add REALMAnswerSpanModel and MLM features · f2094783
  Neel Kant authored May 06, 2020
  
  f2094783
06 May, 2020 4 commits
- addressed jareds comment · c9c69c1e
  mohammad authored May 06, 2020
  
  c9c69c1e
- tested and seems to be working · b1ac9fd3
  mohammad authored May 05, 2020
  
  b1ac9fd3
- added parameters sharing · f257d0ee
  Mohammad authored May 05, 2020
  
  f257d0ee
- added parameters sharing · 80f90dcd
  Mohammad authored May 05, 2020
  
  80f90dcd
05 May, 2020 4 commits
- Debug null document and exclude trivial candidate · c17d880c
  Neel Kant authored May 05, 2020
  
  c17d880c
- Add null block and exclude trivial block · efcee158
  Neel Kant authored May 05, 2020
  
  efcee158
- Refactor and add more REALM arguments · 730266ca
  Neel Kant authored May 05, 2020
  
  730266ca
- Move REALM to use FAISS · a2e64ad5
  Neel Kant authored May 04, 2020
  
  a2e64ad5
03 May, 2020 1 commit
- more for pretrain_realm · 59031aa7
  Neel Kant authored May 03, 2020
  
  59031aa7
29 Apr, 2020 1 commit
- Update and test misc functionality · 6c0a5bd8
  Neel Kant authored Apr 28, 2020
  
  6c0a5bd8
24 Apr, 2020 3 commits
- Add test_retriever.sh · 1eccfc94
  Neel Kant authored Apr 24, 2020
  
  1eccfc94
- Mostly debugged realm-mlm · d7022c72
  Neel Kant authored Apr 24, 2020
  
  d7022c72
- Revise REALMBertModel and REALMRetriever · f42b4d24
  Neel Kant authored Apr 23, 2020
  
  f42b4d24
23 Apr, 2020 1 commit
- Debug test_retriever · ac79d374
  Neel Kant authored Apr 23, 2020
  
  ac79d374
21 Apr, 2020 5 commits
- add test_retriever · 1b44a4c4
  Neel Kant authored Apr 21, 2020
  
  1b44a4c4
- Debug hashed_index.main · 88637044
  Neel Kant authored Apr 21, 2020
  
  88637044
- Add REALMRetriever and some misc · 9a617f6c
  Neel Kant authored Apr 21, 2020
  
  9a617f6c
- Simplify batch and forward for ICT dataset and model · 5235ed87
  Neel Kant authored Apr 21, 2020
  
  5235ed87
- removed bcast in local ddp · 41c1af0e
  Mohammad authored Apr 20, 2020
  
  41c1af0e
20 Apr, 2020 2 commits
- Enhance hashed_index and more improvements elsewhere · 256eb6ed
  Neel Kant authored Apr 20, 2020
  
  256eb6ed
- Start creating REALMBertModel · ee2490d5
  Neel Kant authored Apr 20, 2020
  
  ee2490d5
17 Apr, 2020 1 commit
- Refactor before merge request · 4abd7ce2
  Neel Kant authored Apr 17, 2020
  
  4abd7ce2
16 Apr, 2020 2 commits
- changed licence 2019 to 2020 · 463d1257
  Mohammad authored Apr 16, 2020
  
  463d1257
- Build simple mlm examples · 8b1da95a
  Neel Kant authored Apr 16, 2020
  
  8b1da95a
15 Apr, 2020 2 commits
- added faster L2 grad clipping and new torch gelu · 3ea5491e
  Mohammad authored Apr 14, 2020
  
  3ea5491e
- changed gpt2 masking to binary and masked_fill · 8ceed7c7
  Mohammad authored Apr 14, 2020
  
  8ceed7c7
14 Apr, 2020 1 commit
- Lint whole repo · b7f1b050
  Neel Kant authored Apr 14, 2020
  
  b7f1b050
10 Apr, 2020 1 commit
- fp32 fixes · 5f174c07
  Mohammad authored Apr 10, 2020
  
  5f174c07
09 Apr, 2020 1 commit
- Qualitative test prep works · 360885ee
  Neel Kant authored Apr 09, 2020
  
  360885ee