Commits · 43e274f8693cf04f7f62bf768a5c605c8d388824 · gaoqiong / lm-evaluation-harness

"...torchaudio_unittest/assets/kaldi/resample-16000-29000.ark" did not exist on "616663ffefad40953daf8481b1d45df368dbd2b1"

10 Feb, 2021 11 commits
- Fix context orderings to match label positioning · 43e274f8
  Jon Tow authored Feb 10, 2021
  
  43e274f8
- Update spacing · 8b038c2a
  Leo Gao authored Feb 09, 2021
  
  8b038c2a
- Remove incorrect context from `fewshot_context` · 3a90e246
  Jonathan Tow authored Feb 10, 2021
  
  3a90e246
- Update qa4mre.py · 5960874b
  Leo Gao authored Feb 09, 2021
  
  5960874b
- Add missing space in MultiRC · e9e5d0a2
  Leo Gao authored Feb 09, 2021
  
  e9e5d0a2
- Fix arithmetic · 42df113c
  Leo Gao authored Feb 09, 2021
  
  42df113c
- Update gpt2 for efficiency and allow specifying model size · aab91285
  Leo Gao authored Feb 09, 2021
  
  aab91285
- removed truncation of source · a264f449
  jeffhsu3 authored Feb 10, 2021
  
  a264f449
- Fix few-shot contexts for `Winograd Schema Challenge`-based tasks · 74f3307b
  Jonathan Tow authored Feb 09, 2021
  
  74f3307b
- Fix PiQA · 4d8ed7d5
  Leo Gao authored Feb 09, 2021
  
  4d8ed7d5
- Update RACE format · 62714855
  Leo Gao authored Feb 09, 2021
  
  62714855
09 Feb, 2021 5 commits
- Added qa4mre and changed to best_download for sciq · c05b9940
  jeffhsu3 authored Feb 09, 2021
  
  c05b9940
- More task changes · 9b14235d
  Leo Gao authored Feb 08, 2021
  
  9b14235d
- Fix · 96157fc7
  Leo Gao authored Feb 08, 2021
  
  96157fc7
- Change glue and superglue prompts · c3f724cf
  Leo Gao authored Feb 08, 2021
  
  c3f724cf
- Implement `OpenBookQA` evaluation · aa1d7293
  Jon Tow authored Feb 08, 2021
  
  aa1d7293
08 Feb, 2021 3 commits
- LM: handle empty context · 359114fd
  Leo Gao authored Feb 07, 2021
  
  359114fd
- LAMBADA metric consistency change · dcd44d22
  Leo Gao authored Feb 07, 2021
  
  dcd44d22
- Fix caching · 77d4b087
  Leo Gao authored Feb 07, 2021
  
  77d4b087
06 Feb, 2021 5 commits
- Remove merge conflict · 79878d13
  Leo Gao authored Feb 06, 2021
  
  79878d13
- Fix `PIQA` prompt · c8e77519
  Jonathan Tow authored Feb 06, 2021
  
  c8e77519
- separated sciq and pubmedqa to different files · 0971cffe
  jeffhsu3 authored Feb 06, 2021
  
  0971cffe
- Fix `doc_to_text` passage bug · 715dc759
  Jonathan Tow authored Feb 05, 2021
  
  715dc759
- Remove extra space · 30c2fe23
  Leo Gao authored Feb 05, 2021
```
There shouldn't be any spaces in the beginning of `text`, only `target`
```
  30c2fe23
05 Feb, 2021 12 commits
- sciq · 620c0d26
  jeffhsu3 authored Feb 05, 2021
  
  620c0d26
- Added SciQ · c71dcb91
  jeffhsu3 authored Feb 05, 2021
  
  c71dcb91
- Add task table · c0fbf9e8
  Leo Gao authored Feb 04, 2021
  
  c0fbf9e8
- Add test to make sure right space conventions are used · 049dfa34
  Leo Gao authored Feb 04, 2021
  
  049dfa34
- Fix SAT · aea63162
  Leo Gao authored Feb 04, 2021
  
  aea63162
- Convert SAT to use MultipleChoiceTask · d7c08d5b
  Leo Gao authored Feb 04, 2021
  
  d7c08d5b
- Add MultipleChoiceTest target · 2f5f42c6
  Leo Gao authored Feb 04, 2021
  
  2f5f42c6
- Add MultipleChoiceTask · 706cb53a
  Leo Gao authored Feb 04, 2021
  
  706cb53a
- Add retry with backoff for GPT3 · b1f7284e
  Leo Gao authored Feb 04, 2021
  
  b1f7284e
- Update arithmetic.py · a55a5c52
  Leo Gao authored Feb 04, 2021
  
  a55a5c52
- Get rid of annoying logging · c55e8237
  Leo Gao authored Feb 04, 2021
  
  c55e8237
- Implement caching · d5cd9655
  Leo Gao authored Feb 04, 2021
  
  d5cd9655
04 Feb, 2021 4 commits
- Implement `ARC` evaluation · d72ad5e2
  Jonathan Tow authored Feb 04, 2021
  
  d72ad5e2
- Add missing import · 1815286c
  Leo Gao authored Feb 03, 2021
  
  1815286c
- Implement gpt3 greedy_until · 5f4c7c50
  Leo Gao authored Feb 03, 2021
  
  5f4c7c50
- Get rid of utils_stream · 38e8858f
  Leo Gao authored Feb 03, 2021
  
  38e8858f