Commits · fdd3dbc3b2871d6a0a5433bfa42f56490ee058ab · gaoqiong / lm-evaluation-harness

25 Nov, 2022 1 commit
- Add the original `LAMBADA` dataset · bfa57687
  jon-tow authored Nov 24, 2022
  
  bfa57687
03 May, 2022 2 commits
- Revert `tests/testdata` changes and address flake8 issues · 8c997e53
  jon-tow authored May 03, 2022
  
  8c997e53
- add pre-commit · 121b7096
  Fabrizio Milo authored May 02, 2022
  
  121b7096
29 Apr, 2022 2 commits
- Revert "Merge branch 'master' into master" · 7585ec56
  jon-tow authored Apr 29, 2022
```
This reverts commit 5fe7e2c0, reversing
changes made to 14b8ec7e.
```
  7585ec56
- integrate HuffPost to EvalHarness · 2c165797
  KhalidAlt authored Apr 29, 2022
  
  2c165797
28 Apr, 2022 13 commits
- Update __init__.py · 13676905
  KhalidAlt authored Apr 28, 2022
  
  13676905
- Update __init__.py · 00903bc3
  KhalidAlt authored Apr 28, 2022
```
Add lama and bigscience lama
```
  00903bc3
- Added CrowsPairs for English and French · 2d861a29
  Oskar authored Apr 28, 2022
  
  2d861a29
- comment unimplemented task · 235494f4
  KhalidAlt authored Apr 28, 2022
  
  235494f4
- add lama task · 383318fe
  KhalidAlt authored Apr 28, 2022
  
  383318fe
- added task to init · e04aab6d
  Jan-Christoph Kalo authored Apr 28, 2022
  
  e04aab6d
- GEM Simplification · 8cd91624
  jordiclive authored Apr 28, 2022
  
  8cd91624
- adding challenge sets · d42d5423
  jordiclive authored Apr 28, 2022
  
  d42d5423
- WinoBias support added · 7010e452
  tomlimi authored Apr 28, 2022
  
  7010e452
- Fix `mlsum` task names after split update · 22ea032f
  jon-tow authored Apr 28, 2022
  
  22ea032f
- Fix functions · a80d78db
  Shashi456 authored Apr 28, 2022
  
  a80d78db
- Prettify task __init__ · 6d5031ac
  Shashi456 authored Apr 28, 2022
  
  6d5031ac
- Update gem_mlsum · 9abb1814
  Shashi456 authored Apr 28, 2022
  
  9abb1814
27 Apr, 2022 3 commits
- webnlg · afcea267
  jordiclive authored Apr 27, 2022
  
  afcea267
- Add MLsum Tasks · f42f168c
  Shashi456 authored Apr 27, 2022
  
  f42f168c
- Add a main part of e2e_nlg_cleaned · f777d840
  Zdenek Kasner authored Apr 27, 2022
  
  f777d840
26 Apr, 2022 3 commits
- Turned off generation tasks for now. Changed process to look at the metrics.... · 0cdcc989
  jon-tow authored Apr 25, 2022
```
Turned off generation tasks for now. Changed process to look at the metrics. Only accuracy implemented.
```
  0cdcc989
- Add `HANS` · 0e578306
  jon-tow authored Apr 25, 2022
  
  0e578306
- Temp. commenting our e2e · 31a019c2
  cjlovering authored Apr 25, 2022
  
  31a019c2
25 Apr, 2022 4 commits
- Add multiple tasks · 34f591af
  jon-tow authored Apr 25, 2022
  
  34f591af
- Fix task name to template creation · 9f388461
  jon-tow authored Apr 25, 2022
  
  9f388461
- Initial integration · 88745155
  cjlovering authored Apr 25, 2022
  
  88745155
- Add GEM/xsum · 6a2b94b2
  ken authored Apr 25, 2022
  
  6a2b94b2
12 Apr, 2022 1 commit
- Add `SWAG` · 80f3e064
  jon-tow authored Apr 12, 2022
  
  80f3e064
18 Mar, 2022 1 commit
- Refactor `Task` download · 7c9da714
  Jonathan Tow authored Mar 11, 2022
  
  7c9da714
08 Feb, 2022 1 commit
- Add initial draft of QASPER; register with package; yet to complete process_results · 79492627
  Stephen Hogg authored Feb 08, 2022
  
  79492627
23 Jan, 2022 1 commit
- Add grade school math `GSM8K` · f04a91c1
  Jonathan Tow authored Jan 23, 2022
  
  f04a91c1
26 Dec, 2021 1 commit
- add asdiv task · b0a12310
  rokosbasilisk authored Dec 26, 2021
  
  b0a12310
24 Dec, 2021 4 commits
- Update new `task` arg and task dict getter · 0e232f7a
  Jonathan Tow authored Dec 24, 2021
  
  0e232f7a
- more changes · d86aabc4
  Leo Gao authored Dec 23, 2021
  
  d86aabc4
- Make simple_evaluate take LM and Task objects directly too · 7b2b2a23
  Leo Gao authored Dec 23, 2021
  
  7b2b2a23
- headqa: maintain backwards compatibility · cdab2c03
  Leo Gao authored Dec 23, 2021
  
  cdab2c03
23 Dec, 2021 1 commit
- Allow users to specify en headqa or es · 5855f482
  thomasw21 authored Dec 23, 2021
  
  5855f482
22 Dec, 2021 1 commit
- Add BLiMP · 5f48dfc2
  Igor Ostrovsky authored Dec 21, 2021
  
  5f48dfc2
19 Nov, 2021 1 commit
- Add `truthfulqa` back to the task registry · 33ccde86
  Jonathan Tow authored Nov 19, 2021
  
  33ccde86