Commits · e0cfeb907a829698fd1226c65a2f49d8e6477885 · gaoqiong / lm-evaluation-harness

31 Mar, 2022 3 commits
- Fix docstring · 9434722c
  Jon Tow authored Mar 31, 2022
  
  9434722c
- Adopt `_process_doc` method · 39c8c87f
  Jon Tow authored Mar 31, 2022
  
  39c8c87f
- Add specific `load_dataset` args · d79a4389
  Jon Tow authored Mar 31, 2022
  
  d79a4389
19 Mar, 2022 1 commit
- Whitespace formatting · 4f8b99f6
  Jon Tow authored Mar 19, 2022
  
  4f8b99f6
18 Mar, 2022 4 commits
- Fix dataset value feature · c2e32987
  Jon Tow authored Mar 18, 2022
  
  c2e32987
- Add custom `image`less `HeadQA` dataset · 897ae76d
  Jon Tow authored Mar 18, 2022
  
  897ae76d
- Fix training docs caching · 13317f8c
  Jon Tow authored Mar 18, 2022
  
  13317f8c
- Refactor `Task` download · 7c9da714
  Jonathan Tow authored Mar 11, 2022
  
  7c9da714
06 Mar, 2022 1 commit
- Add positional args to `gsm8k` `download_file` · f91a70d6
  Jonathan Tow authored Mar 06, 2022
  
  f91a70d6
05 Mar, 2022 1 commit
- Remove `Asdiv` `fewshot-description` method · d14ab6d5
  Jonathan Tow authored Mar 05, 2022
  
  d14ab6d5
03 Mar, 2022 1 commit
- Refactor for PR · f495bfb4
  researcher2 authored Mar 03, 2022
  
  f495bfb4
28 Feb, 2022 3 commits
- Correct misspellings · 9e0b7102
  Jonathan Tow authored Feb 28, 2022
  
  9e0b7102
- Make citations module-level constants · 3f13d15f
  Jonathan Tow authored Feb 28, 2022
  
  3f13d15f
- Add citations and descriptions to all tasks · a1aceacd
  Jonathan Tow authored Feb 28, 2022
  
  a1aceacd
25 Feb, 2022 4 commits
- Change function signature so package root is always found from utils.py · 606b98f7
  Stephen Hogg authored Feb 25, 2022
  
  606b98f7
- Add integrity check · 4d8dde31
  Stephen Hogg authored Feb 25, 2022
  
  4d8dde31
- further interface changes · 0f283a9c
  Leo Gao authored Feb 24, 2022
  
  0f283a9c
- pull stuff into lm_eval.decontamination · b2460099
  Leo Gao authored Feb 24, 2022
  
  b2460099
22 Feb, 2022 1 commit
- Don't create requests for TODO metrics · 815f165c
  Stephen Hogg authored Feb 22, 2022
  
  815f165c
21 Feb, 2022 1 commit
- Mark unanswerable as TODO · f7aaff08
  Stephen Hogg authored Feb 22, 2022
  
  f7aaff08
20 Feb, 2022 1 commit

researcher2 authored Feb 21, 2022

Remove arguments from main.py.

Add "decontamination" prefix to ngrams arguments.

98d75af0

13 Feb, 2022 3 commits
- Align casing between doc creation and evaluation · be55ea8c
  Stephen Hogg authored Feb 13, 2022
  
  be55ea8c
- Remove extractive spans score; mark as TODO · 8f0e1765
  Stephen Hogg authored Feb 13, 2022
  
  8f0e1765
- gpt3: print exceptions · f6fb7f6a
  Leo Gao authored Feb 12, 2022
  
  f6fb7f6a
12 Feb, 2022 1 commit
- Update dummy model classmethod args · d895bfe6
  Stephen Hogg authored Feb 12, 2022
  
  d895bfe6
11 Feb, 2022 4 commits
- Remove incorrect comments · af9766d1
  Stephen Hogg authored Feb 12, 2022
  
  af9766d1
- Name changes as per leogao2 · 894c0697
  Stephen Hogg authored Feb 12, 2022
  
  894c0697
- Disable extractive spans · 96f3e5b3
  Stephen Hogg authored Feb 12, 2022
  
  96f3e5b3
- Include extraction in process_results; fixes per test results · c6a35696
  Stephen Hogg authored Feb 11, 2022
  
  c6a35696
09 Feb, 2022 2 commits
- exponentiate unanswerable score; rename dict key · c2f12474
  Stephen Hogg authored Feb 09, 2022
  
  c2f12474
- Add citation; update process_results and construct_requests · 7ed5e29e
  Stephen Hogg authored Feb 09, 2022
  
  7ed5e29e
08 Feb, 2022 1 commit
- Add initial draft of QASPER; register with package; yet to complete process_results · 79492627
  Stephen Hogg authored Feb 08, 2022
  
  79492627
07 Feb, 2022 1 commit
- Update cbt.py · dcef7c8f
  researcher2 authored Feb 08, 2022
  
  dcef7c8f
06 Feb, 2022 1 commit
- Bump Hendrycks `MATH` because of updated dataset · 49dc29bd
  Jonathan Tow authored Feb 06, 2022
  
  49dc29bd
05 Feb, 2022 1 commit
- Added decontamination to remaining evals · dae7b868
  Quentin Gregory Anthony authored Feb 05, 2022
  
  dae7b868
30 Jan, 2022 2 commits
- Small fixes · 341663a9
  researcher2 authored Jan 31, 2022
  
  341663a9
- Added more eval tasks and fixed directory error tasks · bb0eafbb
  Quentin Anthony authored Jan 30, 2022
  
  bb0eafbb
23 Jan, 2022 2 commits
- Update `headqa` deprecation warning to display on init only · 03c15e06
  Jonathan Tow authored Jan 23, 2022
  
  03c15e06
- Add grade school math `GSM8K` · f04a91c1
  Jonathan Tow authored Jan 23, 2022
  
  f04a91c1
13 Jan, 2022 1 commit
- Conform `asidv` to the new description api · caff4f10
  Jonathan Tow authored Jan 13, 2022
  
  caff4f10