Commits · 6495927e7ccf4a67720fd81fe5013f752a71f45c · OpenDAS / Megatron-LM

22 Jun, 2020 1 commit
- Address most of comments from code review w/ Mohammad · 6495927e
  Neel Kant authored Jun 22, 2020
  
  6495927e
10 Jun, 2020 1 commit
- Ran and cleaned up · fcc500d6
  Neel Kant authored Jun 10, 2020
  
  fcc500d6
05 Jun, 2020 1 commit
- Prune changes to only be related to ICT · 32bb4edc
  Neel Kant authored Jun 05, 2020
  
  32bb4edc
19 May, 2020 1 commit
- Reorganize indexer. Things run up to saving model checkpoint and repeating · d4b00be0
  Neel Kant authored May 19, 2020
  
  d4b00be0
15 May, 2020 1 commit
- Able to run REALM with terrible index sync · 0f0f60aa
  Neel Kant authored May 15, 2020
  
  0f0f60aa
14 May, 2020 1 commit
- Add retrieval utility and autoresume for indexer · 2f7d666c
  Neel Kant authored May 14, 2020
  
  2f7d666c
12 May, 2020 3 commits
- Debug and run salient span masking · c150c48b
  Neel Kant authored May 12, 2020
  
  c150c48b
- Add salient span masking, realm_dataset_utils and significant refactor · 451d1325
  Neel Kant authored May 11, 2020
  
  451d1325
- Update indexer.py · 5511c258
  Neel Kant authored May 11, 2020
  
  5511c258
08 Oct, 2019 1 commit
- created megatron package · b886b7bb
  Mohammad Shoeybi authored Oct 08, 2019
  
  b886b7bb
30 Jul, 2019 1 commit

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e