Commits · 59031aa7a8f95120bcfbcfb876980754de5faad9 · OpenDAS / Megatron-LM

"vscode:/vscode.git/clone" did not exist on "baee08601bea983335cf7c06da2f341157cdc225"

03 May, 2020 5 commits
- more for pretrain_realm · 59031aa7
  Neel Kant authored May 03, 2020
  
  59031aa7
- Correct arguments · 002cb170
  Neel Kant authored May 03, 2020
  
  002cb170
- Refactor to build BlockData, FaissMIPSIndex, RandProjectLSHIndex · 183ad176
  Neel Kant authored May 03, 2020
  
  183ad176
- Move InverseClozeDataset to bert_dataset · 0104f910
  Neel Kant authored May 03, 2020
  
  0104f910
- Corrected exact_mips_test · 1e01b3a2
  Neel Kant authored May 02, 2020
  
  1e01b3a2
30 Apr, 2020 5 commits
- Implement MIPS with FAISS · c1c958fa
  Neel Kant authored Apr 30, 2020
  
  c1c958fa
- Reconcile changes with head node · 56bd4804
  Neel Kant authored Apr 30, 2020
  
  56bd4804
- Misc mips-related improvements · 5952c558
  Neel Kant authored Apr 30, 2020
  
  5952c558
- Write MIPS tests in HashedIndex · 3f122ce9
  Neel Kant authored Apr 30, 2020
  
  3f122ce9
- Whitening code · 9d225b44
  Neel Kant authored Apr 29, 2020
  
  9d225b44
29 Apr, 2020 2 commits
- Merge master into realm-mlm · 5e56e563
  Neel Kant authored Apr 28, 2020
  
  5e56e563
- Update and test misc functionality · 6c0a5bd8
  Neel Kant authored Apr 28, 2020
  
  6c0a5bd8
28 Apr, 2020 2 commits
- Merge branch 'l2_grad_clip_fix_script' into 'master' · 569b3dab
  Mohammad Shoeybi authored Apr 27, 2020
```
updated the script

See merge request ADLR/megatron-lm!79
```
  569b3dab
- updated the script · 25234f8a
  Mostofa Patwary authored Apr 27, 2020
  
  25234f8a
27 Apr, 2020 2 commits
- Merge branch 'remove_arg_abv' into 'master' · f46d1c32
  Jared Casper authored Apr 27, 2020
```
remoed abbreviation matching from argparser

See merge request ADLR/megatron-lm!78
```
  f46d1c32
- remoed abbreviation matching from argparser · cf595489
  Mohammad authored Apr 27, 2020
  
  cf595489
24 Apr, 2020 15 commits
- Merge branch 'args_fix' into 'master' · 3262398d
  Raul Puri authored Apr 24, 2020
```
args bug fix

See merge request ADLR/megatron-lm!77
```
  3262398d
- fixed args · 04aa357e
  Mohammad authored Apr 24, 2020
  
  04aa357e
- Merge branch 'cased_update' into 'master' · 3af90c7a
  Mohammad Shoeybi authored Apr 24, 2020
```
added case wordpiece arguments

See merge request ADLR/megatron-lm!76
```
  3af90c7a
- flushed printing · 26c5f12a
  Raul Puri authored Apr 24, 2020
  
  26c5f12a
- addressed printing · 954f0725
  Raul Puri authored Apr 24, 2020
  
  954f0725
- changed default override behavior · d28527d5
  Raul Puri authored Apr 24, 2020
  
  d28527d5
- added case wordpiece arguments · ef5b2f06
  Raul Puri authored Apr 24, 2020
  
  ef5b2f06
- Add test_retriever.sh · 1eccfc94
  Neel Kant authored Apr 24, 2020
  
  1eccfc94
- Mostly debugged realm-mlm · d7022c72
  Neel Kant authored Apr 24, 2020
  
  d7022c72
- REALM arguments · 6f54f50f
  Neel Kant authored Apr 23, 2020
  
  6f54f50f
- Write pretrain_realm.py and misc dataset_type left from earlier · f7f730e1
  Neel Kant authored Apr 23, 2020
  
  f7f730e1
- Revise REALMBertModel and REALMRetriever · f42b4d24
  Neel Kant authored Apr 23, 2020
  
  f42b4d24
- Revise dataset_type · 24034e03
  Neel Kant authored Apr 23, 2020
  
  24034e03
- Restructure BertDataset to help with RealmDataset · cf0100cf
  Neel Kant authored Apr 23, 2020
  
  cf0100cf
- Rename fns to be more precise · f332d7e1
  Neel Kant authored Apr 23, 2020
  
  f332d7e1
23 Apr, 2020 1 commit
- Debug test_retriever · ac79d374
  Neel Kant authored Apr 23, 2020
  
  ac79d374
21 Apr, 2020 8 commits
- Merge branch 'l2_grad_clip_fix' into 'master' · 03d28809
  Mostofa Patwary authored Apr 21, 2020
```
Reverting l2 grad optimization

See merge request ADLR/megatron-lm!74
```
  03d28809
- HashedIndex.load_from_file · 3fb02b8e
  Neel Kant authored Apr 21, 2020
  
  3fb02b8e
- add test_retriever · 1b44a4c4
  Neel Kant authored Apr 21, 2020
  
  1b44a4c4
- Debug hashed_index.main · 88637044
  Neel Kant authored Apr 21, 2020
  
  88637044
- Add REALMRetriever and some misc · 9a617f6c
  Neel Kant authored Apr 21, 2020
  
  9a617f6c
- Simplify batch and forward for ICT dataset and model · 5235ed87
  Neel Kant authored Apr 21, 2020
  
  5235ed87
- Merge branch 'master' into l2_grad_clip_fix · d218f9cf
  Mohammad authored Apr 21, 2020
  
  d218f9cf
- Merge branch 'remove_local_ddp_bcast' into 'master' · 3c709cba
  Raul Puri authored Apr 21, 2020
```
removed bcast from local ddp

See merge request ADLR/megatron-lm!72
```
  3c709cba