Commits · 56bd48045ffc4e9ff56aa4ea921774554432a5ff · OpenDAS / Megatron-LM

30 Apr, 2020 4 commits
- Reconcile changes with head node · 56bd4804
  Neel Kant authored Apr 30, 2020
  
  56bd4804
- Misc mips-related improvements · 5952c558
  Neel Kant authored Apr 30, 2020
  
  5952c558
- Write MIPS tests in HashedIndex · 3f122ce9
  Neel Kant authored Apr 30, 2020
  
  3f122ce9
- Whitening code · 9d225b44
  Neel Kant authored Apr 29, 2020
  
  9d225b44
29 Apr, 2020 2 commits
- Merge master into realm-mlm · 5e56e563
  Neel Kant authored Apr 28, 2020
  
  5e56e563
- Update and test misc functionality · 6c0a5bd8
  Neel Kant authored Apr 28, 2020
  
  6c0a5bd8
28 Apr, 2020 2 commits
- Merge branch 'l2_grad_clip_fix_script' into 'master' · 569b3dab
  Mohammad Shoeybi authored Apr 27, 2020
```
updated the script

See merge request ADLR/megatron-lm!79
```
  569b3dab
- updated the script · 25234f8a
  Mostofa Patwary authored Apr 27, 2020
  
  25234f8a
27 Apr, 2020 2 commits
- Merge branch 'remove_arg_abv' into 'master' · f46d1c32
  Jared Casper authored Apr 27, 2020
```
remoed abbreviation matching from argparser

See merge request ADLR/megatron-lm!78
```
  f46d1c32
- remoed abbreviation matching from argparser · cf595489
  Mohammad authored Apr 27, 2020
  
  cf595489
24 Apr, 2020 15 commits
- Merge branch 'args_fix' into 'master' · 3262398d
  Raul Puri authored Apr 24, 2020
```
args bug fix

See merge request ADLR/megatron-lm!77
```
  3262398d
- fixed args · 04aa357e
  Mohammad authored Apr 24, 2020
  
  04aa357e
- Merge branch 'cased_update' into 'master' · 3af90c7a
  Mohammad Shoeybi authored Apr 24, 2020
```
added case wordpiece arguments

See merge request ADLR/megatron-lm!76
```
  3af90c7a
- flushed printing · 26c5f12a
  Raul Puri authored Apr 24, 2020
  
  26c5f12a
- addressed printing · 954f0725
  Raul Puri authored Apr 24, 2020
  
  954f0725
- changed default override behavior · d28527d5
  Raul Puri authored Apr 24, 2020
  
  d28527d5
- added case wordpiece arguments · ef5b2f06
  Raul Puri authored Apr 24, 2020
  
  ef5b2f06
- Add test_retriever.sh · 1eccfc94
  Neel Kant authored Apr 24, 2020
  
  1eccfc94
- Mostly debugged realm-mlm · d7022c72
  Neel Kant authored Apr 24, 2020
  
  d7022c72
- REALM arguments · 6f54f50f
  Neel Kant authored Apr 23, 2020
  
  6f54f50f
- Write pretrain_realm.py and misc dataset_type left from earlier · f7f730e1
  Neel Kant authored Apr 23, 2020
  
  f7f730e1
- Revise REALMBertModel and REALMRetriever · f42b4d24
  Neel Kant authored Apr 23, 2020
  
  f42b4d24
- Revise dataset_type · 24034e03
  Neel Kant authored Apr 23, 2020
  
  24034e03
- Restructure BertDataset to help with RealmDataset · cf0100cf
  Neel Kant authored Apr 23, 2020
  
  cf0100cf
- Rename fns to be more precise · f332d7e1
  Neel Kant authored Apr 23, 2020
  
  f332d7e1
23 Apr, 2020 1 commit
- Debug test_retriever · ac79d374
  Neel Kant authored Apr 23, 2020
  
  ac79d374
21 Apr, 2020 14 commits
- Merge branch 'l2_grad_clip_fix' into 'master' · 03d28809
  Mostofa Patwary authored Apr 21, 2020
```
Reverting l2 grad optimization

See merge request ADLR/megatron-lm!74
```
  03d28809
- HashedIndex.load_from_file · 3fb02b8e
  Neel Kant authored Apr 21, 2020
  
  3fb02b8e
- add test_retriever · 1b44a4c4
  Neel Kant authored Apr 21, 2020
  
  1b44a4c4
- Debug hashed_index.main · 88637044
  Neel Kant authored Apr 21, 2020
  
  88637044
- Add REALMRetriever and some misc · 9a617f6c
  Neel Kant authored Apr 21, 2020
  
  9a617f6c
- Simplify batch and forward for ICT dataset and model · 5235ed87
  Neel Kant authored Apr 21, 2020
  
  5235ed87
- Merge branch 'master' into l2_grad_clip_fix · d218f9cf
  Mohammad authored Apr 21, 2020
  
  d218f9cf
- Merge branch 'remove_local_ddp_bcast' into 'master' · 3c709cba
  Raul Puri authored Apr 21, 2020
```
removed bcast from local ddp

See merge request ADLR/megatron-lm!72
```
  3c709cba
- removed optimized l2 grad clipping · 0b6bdca6
  Mohammad authored Apr 21, 2020
  
  0b6bdca6
- Create HashedIndex class · aae93362
  Neel Kant authored Apr 21, 2020
  
  aae93362
- fixed a bug in l2 grad clip · 4ff2c963
  Mohammad authored Apr 20, 2020
  
  4ff2c963
- fixed a bug in l2 grad clip · fb5b2b36
  Mohammad authored Apr 20, 2020
  
  fb5b2b36
- Merge branch 'bert-vocab-chkpt' into 'master' · 73f73b81
  Mohammad Shoeybi authored Apr 20, 2020
```
Update README.md

See merge request ADLR/megatron-lm!73
```
  73f73b81
- Update README.md · 89462697
  Raul Puri authored Apr 20, 2020
  
  89462697