Commits · dfb907fe557c5fe8f46c2501b4a87ed4e1bd9c46 · OpenDAS / Megatron-LM

27 May, 2020 2 commits
- Correct indexer seq length · dfb907fe
  Neel Kant authored May 27, 2020
  
  dfb907fe
- Correct CrossEntropyLoss · 0e8f4331
  Neel Kant authored May 27, 2020
  
  0e8f4331
26 May, 2020 1 commit
- Corrected realm example building, misc improvements for async concurrency · 2fd4ea6c
  Neel Kant authored May 25, 2020
  
  2fd4ea6c
24 May, 2020 1 commit
- Fix token alignment, add mpu checkpointing, misc training code · 8e22824e
  Neel Kant authored May 24, 2020
  
  8e22824e
21 May, 2020 1 commit
- Change sync variable to gloo backend · 05ea0cca
  Neel Kant authored May 21, 2020
  
  05ea0cca
20 May, 2020 1 commit
- Async works for total 8 GPU, indexer debug mode · a670b6c9
  Neel Kant authored May 19, 2020
  
  a670b6c9
19 May, 2020 2 commits
- Full cycle of communication complete. Also added BasicIndexBuilder · 5684f904
  Neel Kant authored May 19, 2020
  
  5684f904
- Reorganize indexer. Things run up to saving model checkpoint and repeating · d4b00be0
  Neel Kant authored May 19, 2020
  
  d4b00be0
12 May, 2020 1 commit
- Debug and run salient span masking · c150c48b
  Neel Kant authored May 12, 2020
  
  c150c48b
07 May, 2020 1 commit
- Add primitive filesystem-based IPC for indexer and trainer jobs · 15d0d55b
  Neel Kant authored May 07, 2020
  
  15d0d55b
29 Apr, 2020 1 commit
- Update and test misc functionality · 6c0a5bd8
  Neel Kant authored Apr 28, 2020
  
  6c0a5bd8
24 Apr, 2020 1 commit
- Mostly debugged realm-mlm · d7022c72
  Neel Kant authored Apr 24, 2020
  
  d7022c72
17 Apr, 2020 1 commit
- Refactor before merge request · 4abd7ce2
  Neel Kant authored Apr 17, 2020
  
  4abd7ce2
16 Apr, 2020 1 commit
- changed licence 2019 to 2020 · 463d1257
  Mohammad authored Apr 16, 2020
  
  463d1257
15 Apr, 2020 1 commit
- using None for resetting gradients · 3a701586
  Mohammad authored Apr 14, 2020
  
  3a701586
14 Apr, 2020 1 commit
- Lint whole repo · b7f1b050
  Neel Kant authored Apr 14, 2020
  
  b7f1b050
13 Apr, 2020 1 commit
- data loading for BERT and GPT cleaned up · 2e38461b
  Mohammad authored Apr 12, 2020
  
  2e38461b
10 Apr, 2020 1 commit
- fp32 fixes · 5f174c07
  Mohammad authored Apr 10, 2020
  
  5f174c07
07 Apr, 2020 1 commit
- Fix issue with validation dataloader · 064bdc46
  Neel Kant authored Apr 07, 2020
  
  064bdc46
01 Apr, 2020 1 commit
- addressed comments from raul, neel, and jared · bf3ce751
  Mohammad authored Apr 01, 2020
  
  bf3ce751
31 Mar, 2020 1 commit
- Remove debug statements and correct dataloader · 6f56b909
  Neel Kant authored Mar 31, 2020
  
  6f56b909
30 Mar, 2020 1 commit
- Add debug statements · f1b2524b
  Neel Kant authored Mar 30, 2020
  
  f1b2524b
29 Mar, 2020 3 commits
- refactored learning-rate · b6e0377b
  Mohammad authored Mar 29, 2020
  
  b6e0377b
- refactored training · 27e14f82
  Mohammad authored Mar 28, 2020
  
  27e14f82
- utils partially refactored and tested · 3f58649b
  Mohammad authored Mar 28, 2020
  
  3f58649b
28 Mar, 2020 2 commits
- working on utils · 5050203f
  Mohammad authored Mar 28, 2020
  
  5050203f
- arguments.py refactored · 94e2ca57
  Mohammad authored Mar 27, 2020
  
  94e2ca57
27 Mar, 2020 2 commits
- added global variables · 83aa9219
  Mohammad authored Mar 27, 2020
  
  83aa9219
- working on bert · 599e959a
  Mohammad authored Mar 26, 2020
  
  599e959a
24 Mar, 2020 1 commit
- BERT downstream tasks: RACE, MNLI, QQP · 90ef2e28
  Mohammad Shoeybi authored Mar 23, 2020
  
  90ef2e28
19 Nov, 2019 1 commit
- Plumbing for new albert dataset, including mods to arguments for data loaders. · 1a1cfcff
  Jared Casper authored Nov 18, 2019
  
  1a1cfcff
31 Oct, 2019 1 commit
- refacotred for code reuse · 34be7dd3
  Mohammad Shoeybi authored Oct 30, 2019
  
  34be7dd3
29 Oct, 2019 1 commit
- Major refactoring, combining gpt2 and bert · 73af1290
  Mohammad Shoeybi authored Oct 29, 2019
  
  73af1290