Commits · 9b174da873cf8e84f1bef1b6a88d98ff7791946e · OpenDAS / Megatron-LM

19 Dec, 2020 1 commit
- Rename --batch-size to --micro-batch-size and drop in-minibatch from... · 9019bbf4
  mohammad authored Dec 06, 2020
```
Rename --batch-size to --micro-batch-size and drop in-minibatch from --num-micro-batches-in-minibatch
```
  9019bbf4
29 Nov, 2020 1 commit
- implemented blending datasets · 65290033
  mohammad authored Nov 28, 2020
  
  65290033
23 Jul, 2020 1 commit
- Address comments from last week · 11f76cd3
  Neel Kant authored Jul 22, 2020
  
  11f76cd3
02 Jul, 2020 1 commit
- One sentence options · 03feecbc
  Neel Kant authored Jul 02, 2020
  
  03feecbc
29 Jun, 2020 1 commit
- Changes after running on draco · 44860f8d
  Neel Kant authored Jun 28, 2020
  
  44860f8d
25 Jun, 2020 1 commit
- Add stanza NER salient span masking · e7045139
  Neel Kant authored Jun 24, 2020
  
  e7045139
24 Jun, 2020 1 commit
- More ict_merge changes and interactive testing · 3354081f
  Neel Kant authored Jun 23, 2020
  
  3354081f
22 Jun, 2020 1 commit
- Address most of comments from code review w/ Mohammad · 6495927e
  Neel Kant authored Jun 22, 2020
  
  6495927e
15 Jun, 2020 1 commit
- Debugging done on Circe · b8bb0b49
  Mohammad authored Jun 15, 2020
  
  b8bb0b49
10 Jun, 2020 1 commit
- Ran and cleaned up · fcc500d6
  Neel Kant authored Jun 10, 2020
  
  fcc500d6
09 Jun, 2020 2 commits
- Fix samples mapping bug · e3c57c82
  Neel Kant authored Jun 08, 2020
  
  e3c57c82
- Correct retrieval utility and add salient span preprocessing · bf599e86
  Neel Kant authored Jun 08, 2020
  
  bf599e86
05 Jun, 2020 1 commit
- Prune changes to only be related to ICT · 32bb4edc
  Neel Kant authored Jun 05, 2020
  
  32bb4edc
31 May, 2020 1 commit
- Misc changes · 51204a4d
  Neel Kant authored May 30, 2020
  
  51204a4d
19 May, 2020 1 commit
- Reorganize indexer. Things run up to saving model checkpoint and repeating · d4b00be0
  Neel Kant authored May 19, 2020
  
  d4b00be0
15 May, 2020 1 commit
- Able to run REALM with terrible index sync · 0f0f60aa
  Neel Kant authored May 15, 2020
  
  0f0f60aa
14 May, 2020 1 commit
- Add retrieval utility and autoresume for indexer · 2f7d666c
  Neel Kant authored May 14, 2020
  
  2f7d666c
12 May, 2020 3 commits
- Debug and run salient span masking · c150c48b
  Neel Kant authored May 12, 2020
  
  c150c48b
- Add salient span masking, realm_dataset_utils and significant refactor · 451d1325
  Neel Kant authored May 11, 2020
  
  451d1325
- Update indexer.py · 5511c258
  Neel Kant authored May 11, 2020
  
  5511c258
08 Oct, 2019 1 commit
- created megatron package · b886b7bb
  Mohammad Shoeybi authored Oct 08, 2019
  
  b886b7bb
30 Jul, 2019 1 commit

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e