Commits · 2a3b445d4b15df0857f019a167abe6bbd322f077 · OpenDAS / Megatron-LM

26 Jun, 2020 1 commit
- Cosmetic changes · 2a3b445d
  Neel Kant authored Jun 26, 2020
  
  2a3b445d
24 Jun, 2020 2 commits
- Fix accidental comment · 1f514406
  Neel Kant authored Jun 23, 2020
  
  1f514406
- More ict_merge changes and interactive testing · 3354081f
  Neel Kant authored Jun 23, 2020
  
  3354081f
22 Jun, 2020 1 commit
- Address most of comments from code review w/ Mohammad · 6495927e
  Neel Kant authored Jun 22, 2020
  
  6495927e
10 Jun, 2020 3 commits
- gpt2 mmap sample map · dd76c914
  Raul Puri authored Jun 10, 2020
  
  dd76c914
- mmap sample map · 2b47c5e7
  Raul Puri authored Jun 10, 2020
  
  2b47c5e7
- Ran and cleaned up · fcc500d6
  Neel Kant authored Jun 10, 2020
  
  fcc500d6
05 Jun, 2020 7 commits
- addressed jareds comments · 197c132e
  mohammad authored Jun 05, 2020
  
  197c132e
- added fp16 lm cross entropy to bert · 78022005
  mohammad authored Jun 05, 2020
  
  78022005
- added fp16 cross entropy loss option for gpt2 · 22e3c7e6
  mohammad authored Jun 05, 2020
  
  22e3c7e6
- added fp16 cross entropy loss option for gpt2 · acfe848e
  mohammad authored Jun 05, 2020
  
  acfe848e
- Some changes noticed late · c044f59a
  Neel Kant authored Jun 05, 2020
  
  c044f59a
- Prune changes to only be related to ICT · 32bb4edc
  Neel Kant authored Jun 05, 2020
  
  32bb4edc
- testing · 2ede8235
  mohammad authored Jun 05, 2020
  
  2ede8235
28 May, 2020 1 commit
- Add bm25 evaluation code · 8409e1c1
  Neel Kant authored May 28, 2020
  
  8409e1c1
27 May, 2020 2 commits
- Correct indexer seq length · dfb907fe
  Neel Kant authored May 27, 2020
  
  dfb907fe
- Correct CrossEntropyLoss · 0e8f4331
  Neel Kant authored May 27, 2020
  
  0e8f4331
26 May, 2020 1 commit
- Corrected realm example building, misc improvements for async concurrency · 2fd4ea6c
  Neel Kant authored May 25, 2020
  
  2fd4ea6c
24 May, 2020 2 commits
- Fix token alignment, add mpu checkpointing, misc training code · 8e22824e
  Neel Kant authored May 24, 2020
  
  8e22824e
- Use Faiss GPU index and report retrieval utility · 8573ab35
  Neel Kant authored May 24, 2020
  
  8573ab35
21 May, 2020 1 commit
- Change sync variable to gloo backend · 05ea0cca
  Neel Kant authored May 21, 2020
  
  05ea0cca
20 May, 2020 1 commit
- Async works for total 8 GPU, indexer debug mode · a670b6c9
  Neel Kant authored May 19, 2020
  
  a670b6c9
19 May, 2020 3 commits
- Full cycle of communication complete. Also added BasicIndexBuilder · 5684f904
  Neel Kant authored May 19, 2020
  
  5684f904
- Reorganize indexer. Things run up to saving model checkpoint and repeating · d4b00be0
  Neel Kant authored May 19, 2020
  
  d4b00be0
- Indexer_async works in theory · e338e311
  Neel Kant authored May 18, 2020
  
  e338e311
15 May, 2020 1 commit
- Able to run REALM with terrible index sync · 0f0f60aa
  Neel Kant authored May 15, 2020
  
  0f0f60aa
14 May, 2020 9 commits
- update · 14fac298
  Evelina Bakhturina authored May 14, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  14fac298
- license · eb641b07
  Evelina Bakhturina authored May 14, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  eb641b07
- update · c60fb37e
  Evelina Bakhturina authored May 14, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  c60fb37e
- helpers.cpp suupport added, version changed, clean up · dd483295
  Evelina Bakhturina authored Apr 28, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  dd483295
- review feedback · cd3529b9
  Evelina Bakhturina authored Apr 21, 2020
  
  cd3529b9
- clean up · 71f9e76c
  Evelina Bakhturina authored Apr 21, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  71f9e76c
- pip support added · bf1daf86
  Evelina Bakhturina authored Apr 21, 2020
```
Signed-off-by: Evelina Bakhturina <ebakhturina@nvidia.com>
```
  bf1daf86
- Add retrieval utility and autoresume for indexer · 2f7d666c
  Neel Kant authored May 14, 2020
  
  2f7d666c
- Minor adjustments to fit QA codebase · 9b9b8e01
  Neel Kant authored May 14, 2020
  
  9b9b8e01
12 May, 2020 4 commits
- faiss use_gpu · 6e256445
  Neel Kant authored May 12, 2020
  
  6e256445
- Debug and run salient span masking · c150c48b
  Neel Kant authored May 12, 2020
  
  c150c48b
- Add salient span masking, realm_dataset_utils and significant refactor · 451d1325
  Neel Kant authored May 11, 2020
  
  451d1325
- Update indexer.py · 5511c258
  Neel Kant authored May 11, 2020
  
  5511c258
07 May, 2020 1 commit
- Add primitive filesystem-based IPC for indexer and trainer jobs · 15d0d55b
  Neel Kant authored May 07, 2020
  
  15d0d55b