Commits · 5e56e56399224abd135e4ac2f2e5d25db0f2a877 · OpenDAS / Megatron-LM

29 Apr, 2020 1 commit
- Update and test misc functionality · 6c0a5bd8
  Neel Kant authored Apr 28, 2020
  
  6c0a5bd8
27 Apr, 2020 1 commit
- remoed abbreviation matching from argparser · cf595489
  Mohammad authored Apr 27, 2020
  
  cf595489
24 Apr, 2020 11 commits
- fixed args · 04aa357e
  Mohammad authored Apr 24, 2020
  
  04aa357e
- flushed printing · 26c5f12a
  Raul Puri authored Apr 24, 2020
  
  26c5f12a
- addressed printing · 954f0725
  Raul Puri authored Apr 24, 2020
  
  954f0725
- changed default override behavior · d28527d5
  Raul Puri authored Apr 24, 2020
  
  d28527d5
- added case wordpiece arguments · ef5b2f06
  Raul Puri authored Apr 24, 2020
  
  ef5b2f06
- Add test_retriever.sh · 1eccfc94
  Neel Kant authored Apr 24, 2020
  
  1eccfc94
- Mostly debugged realm-mlm · d7022c72
  Neel Kant authored Apr 24, 2020
  
  d7022c72
- REALM arguments · 6f54f50f
  Neel Kant authored Apr 23, 2020
  
  6f54f50f
- Revise REALMBertModel and REALMRetriever · f42b4d24
  Neel Kant authored Apr 23, 2020
  
  f42b4d24
- Revise dataset_type · 24034e03
  Neel Kant authored Apr 23, 2020
  
  24034e03
- Restructure BertDataset to help with RealmDataset · cf0100cf
  Neel Kant authored Apr 23, 2020
  
  cf0100cf
23 Apr, 2020 1 commit
- Debug test_retriever · ac79d374
  Neel Kant authored Apr 23, 2020
  
  ac79d374
21 Apr, 2020 9 commits
- add test_retriever · 1b44a4c4
  Neel Kant authored Apr 21, 2020
  
  1b44a4c4
- Debug hashed_index.main · 88637044
  Neel Kant authored Apr 21, 2020
  
  88637044
- Add REALMRetriever and some misc · 9a617f6c
  Neel Kant authored Apr 21, 2020
  
  9a617f6c
- Simplify batch and forward for ICT dataset and model · 5235ed87
  Neel Kant authored Apr 21, 2020
  
  5235ed87
- removed optimized l2 grad clipping · 0b6bdca6
  Mohammad authored Apr 21, 2020
  
  0b6bdca6
- fixed a bug in l2 grad clip · 4ff2c963
  Mohammad authored Apr 20, 2020
  
  4ff2c963
- fixed a bug in l2 grad clip · fb5b2b36
  Mohammad authored Apr 20, 2020
  
  fb5b2b36
- removed bcast in local ddp · 41c1af0e
  Mohammad authored Apr 20, 2020
  
  41c1af0e
- added option to ignore unknown input arguments · 5531663b
  Mohammad authored Apr 20, 2020
  
  5531663b
20 Apr, 2020 2 commits
- Enhance hashed_index and more improvements elsewhere · 256eb6ed
  Neel Kant authored Apr 20, 2020
  
  256eb6ed
- Start creating REALMBertModel · ee2490d5
  Neel Kant authored Apr 20, 2020
  
  ee2490d5
17 Apr, 2020 1 commit
- Refactor before merge request · 4abd7ce2
  Neel Kant authored Apr 17, 2020
  
  4abd7ce2
16 Apr, 2020 8 commits
- changed licence 2019 to 2020 · 463d1257
  Mohammad authored Apr 16, 2020
  
  463d1257
- make minor modifications to licnese wording · 39af7956
  Mohammad authored Apr 16, 2020
  
  39af7956
- Build simple mlm examples · 8b1da95a
  Neel Kant authored Apr 16, 2020
  
  8b1da95a
- Better error reporting when a dataset doesn't exist. · f2779b18
  Jared Casper authored Apr 16, 2020
  
  f2779b18
- Check that the dataset helpers make runs successfully. · 9073c4bd
  Jared Casper authored Apr 16, 2020
  
  9073c4bd
- Include comprehensive block info when hashing · e6f2720d
  Neel Kant authored Apr 15, 2020
  
  e6f2720d
- Embedding and hashing docs script works · f3d2426e
  Neel Kant authored Apr 15, 2020
  
  f3d2426e
- added runtime compilation for helpers · c6882114
  Mohammad authored Apr 15, 2020
  
  c6882114
15 Apr, 2020 6 commits
- addressed jareds comment · a4489ffb
  Mohammad authored Apr 15, 2020
  
  a4489ffb
- addressed jareds comments · b6e73188
  Mohammad authored Apr 15, 2020
  
  b6e73188
- Debug hash dump · 662dc982
  Neel Kant authored Apr 15, 2020
  
  662dc982
- Implement reformer hashing scheme · 81c71789
  Neel Kant authored Apr 15, 2020
  
  81c71789
- added faster L2 grad clipping and new torch gelu · 3ea5491e
  Mohammad authored Apr 14, 2020
  
  3ea5491e
- added multi-tensor-apply to fp16 · 99410264
  Mohammad authored Apr 14, 2020
  
  99410264