Commits · 43f4d418e4785472e65df164a0a4da5103bcdeae · gaoqiong / lm-evaluation-harness

13 May, 2021 1 commit
- Remove PileCommonCrawl (empty task) · 43f4d418
  Leo Gao authored May 12, 2021
  
  43f4d418
06 May, 2021 2 commits
- Fix Typo · dd573a95
  Leo Gao authored May 06, 2021
  
  dd573a95
- Rename a ton of stuff · 45127aa7
  Leo Gao authored May 05, 2021
  
  45127aa7
05 May, 2021 1 commit
- Fix some things for tests · 80a739eb
  Leo Gao authored May 05, 2021
  
  80a739eb
03 May, 2021 2 commits
- add pile tasks · 82880154
  Jason Phang authored May 02, 2021
  
  82880154
- gpt2 perplexity · 9454c839
  Jason Phang authored May 02, 2021
  
  9454c839
22 Apr, 2021 2 commits
- Make hendrycks math tar extraction quieter · 853afa36
  Leo Gao authored Apr 22, 2021
  
  853afa36
- Fix first-run error · dd8d3529
  Leo Gao authored Apr 22, 2021
  
  dd8d3529
21 Apr, 2021 1 commit
- Disable triviaqa and cbt tasks · ab0e4d26
  Leo Gao authored Apr 20, 2021
  
  ab0e4d26
11 Apr, 2021 6 commits
- Fix triviaqa · 5dc4692a
  Leo Gao authored Apr 10, 2021
  
  5dc4692a
- Fix typo · 29c1f228
  Leo Gao authored Apr 10, 2021
  
  29c1f228
- Factor _convert_standard into MultipleChoiceTask · ec16d81d
  Leo Gao authored Apr 10, 2021
  
  ec16d81d
- Fix import · 1ebf41d3
  Leo Gao authored Apr 10, 2021
  
  1ebf41d3
- Make piqa inherit MultipleChoiceTask · 4462e415
  Leo Gao authored Apr 10, 2021
  
  4462e415
- also apply normalization to piqa · 2522c27f
  Ben Wang authored Apr 11, 2021
  
  2522c27f
10 Apr, 2021 3 commits
- Use more inheritance · 7ba8c183
  Leo Gao authored Apr 10, 2021
  
  7ba8c183
- add cloze variant of lambada task for allegeldy improved few shot results · 47382717
  Ben Wang authored Apr 10, 2021
  
  47382717
- Fix triviaqa memory consumption problem · e971baac
  Leo Gao authored Apr 09, 2021
```
(or rather, move it to the data download phase)
```
  e971baac
31 Mar, 2021 4 commits
- Add note on accuracy reporting · d78917a7
  Jon Tow authored Mar 31, 2021
  
  d78917a7
- Clean up `Ethics` few-shot prompts · 48ae5457
  Jon Tow authored Mar 31, 2021
  
  48ae5457
- Remove unused simple_accuracy_metric · 59a0104d
  Leo Gao authored Mar 30, 2021
  
  59a0104d
- Add "choices" to logiqa, hendrycksTest · 2ced79f5
  Leo Gao authored Mar 30, 2021
  
  2ced79f5
29 Mar, 2021 2 commits
- Add example header · 310ca7a8
  Leo Gao authored Mar 29, 2021
  
  310ca7a8
- Implement `Childrens Book Test` dataset download and evaluation · a10856dc
  Jon Tow authored Mar 29, 2021
  
  a10856dc
28 Mar, 2021 4 commits
- Rename hendrycks ethics and math · 42659c34
  Leo Gao authored Mar 28, 2021
  
  42659c34
- Rename task · 8de85534
  Leo Gao authored Mar 28, 2021
  
  8de85534
- squad: fix aggregation · cbc5c9c8
  Leo Gao authored Mar 28, 2021
  
  cbc5c9c8
- Update superglue winograd has_test_docs · 5643f20f
  Leo Gao authored Mar 28, 2021
  
  5643f20f
27 Mar, 2021 7 commits
- Fix translation prompting · a69ba385
  Leo Gao authored Mar 26, 2021
  
  a69ba385
- Mark GLUE and SuperGLUE tasks without labelled test docs as not having test docs at all · fa7b9643
  Leo Gao authored Mar 26, 2021
  
  fa7b9643
- Remove import of the non-existent `NLP_TASK` module · ddc044eb
  Jonathan Tow authored Mar 27, 2021
  
  ddc044eb
- Remove unused imports and format imports · d5d19219
  Jonathan Tow authored Mar 26, 2021
  
  d5d19219
- Minor updates · bc5478a1
  Leo Gao authored Mar 26, 2021
  
  bc5478a1
- Fix stuff and make tests pass · c971fa82
  Leo Gao authored Mar 26, 2021
  
  c971fa82
- Pass random state around to fewshot_examples and fewshot_context · 3b2d5f6c
  Leo Gao authored Mar 26, 2021
  
  3b2d5f6c
26 Mar, 2021 4 commits
- qa4mre: remove fewshot_examples that uses test docs · c84a4af4
  Leo Gao authored Mar 25, 2021
  
  c84a4af4
- naturalqs: update random · d7b20fe2
  Leo Gao authored Mar 25, 2021
  
  d7b20fe2
- wsc273: change random · d42af30d
  Leo Gao authored Mar 25, 2021
  
  d42af30d
- PubmedQA: remove redundant fewshot_experiments · dc1a17b1
  Leo Gao authored Mar 25, 2021
  
  dc1a17b1
25 Mar, 2021 1 commit
- Update fewshot_examples · e2112196
  Leo Gao authored Mar 25, 2021
  
  e2112196