Commits · 1f8a8c1dc95a475f0b6fd3cc082e89a674c072d7 · gaoqiong / lm-evaluation-harness

03 May, 2022 1 commit
- add pre-commit · 121b7096
  Fabrizio Milo authored May 02, 2022
  
  121b7096
31 Mar, 2022 1 commit
- Adopt `_process_doc` method · 39c8c87f
  Jon Tow authored Mar 31, 2022
  
  39c8c87f
18 Mar, 2022 3 commits
- Add custom `image`less `HeadQA` dataset · 897ae76d
  Jon Tow authored Mar 18, 2022
  
  897ae76d
- Fix training docs caching · 13317f8c
  Jon Tow authored Mar 18, 2022
  
  13317f8c
- Refactor `Task` download · 7c9da714
  Jonathan Tow authored Mar 11, 2022
  
  7c9da714
28 Feb, 2022 2 commits
- Make citations module-level constants · 3f13d15f
  Jonathan Tow authored Feb 28, 2022
  
  3f13d15f
- Add citations and descriptions to all tasks · a1aceacd
  Jonathan Tow authored Feb 28, 2022
  
  a1aceacd
05 Feb, 2022 1 commit
- Added decontamination to remaining evals · dae7b868
  Quentin Gregory Anthony authored Feb 05, 2022
  
  dae7b868
23 Jan, 2022 1 commit
- Update `headqa` deprecation warning to display on init only · 03c15e06
  Jonathan Tow authored Jan 23, 2022
  
  03c15e06
24 Dec, 2021 1 commit
- headqa: maintain backwards compatibility · cdab2c03
  Leo Gao authored Dec 23, 2021
  
  cdab2c03
23 Dec, 2021 1 commit
- Allow users to specify en headqa or es · 5855f482
  thomasw21 authored Dec 23, 2021
  
  5855f482
30 Oct, 2021 1 commit
- Replace the `fewshot_description` API with a `description_dict` based interface · 8ac99269
  Jonathan Tow authored Oct 30, 2021
  
  8ac99269
05 Jun, 2021 1 commit
- Add task versioning · 105fa974
  Leo Gao authored Jun 04, 2021
  
  105fa974
11 Apr, 2021 1 commit
- Factor _convert_standard into MultipleChoiceTask · ec16d81d
  Leo Gao authored Apr 10, 2021
  
  ec16d81d
13 Feb, 2021 1 commit
- Refactor `HeadQA` as a `MultipleChoiceTask` · 97174266
  Jonathan Tow authored Feb 13, 2021
  
  97174266
12 Feb, 2021 2 commits
- refactor MathQA as MultipleChoiceTask, uses full words for Q. and A. · c6c67272
  Anthony DiPofi authored Feb 12, 2021
  
  c6c67272
- add headqa and mathqa datasets · 742b5df2
  Anthony DiPofi authored Feb 11, 2021
  
  742b5df2
09 Feb, 2021 1 commit
- More task changes · 9b14235d
  Leo Gao authored Feb 08, 2021
  
  9b14235d
01 Feb, 2021 1 commit
- Fix linting problems · fe4a1efd
  Leo Gao authored Feb 01, 2021
  
  fe4a1efd
31 Jan, 2021 1 commit
- add webqs evaluation and fallback to test set when validation is unavailable · 34eb121f
  Anthony DiPofi authored Jan 31, 2021
  
  34eb121f
22 Jan, 2021 2 commits
- Remove rewrite reminder comment from everything except SuperGLUE · f4120e59
  Leo Gao authored Jan 21, 2021
  
  f4120e59
- Clean up code, remove some footguns · e31b4b31
  Leo Gao authored Jan 21, 2021
  
  e31b4b31
13 Jan, 2021 1 commit
- Move `doc_to_text` target code into `doc_to_target` · d77241eb
  Jonathan Tow authored Jan 13, 2021
  
  d77241eb
06 Jan, 2021 1 commit
- Add comments to remind that evaluation needs to be written for the new framework · 2d2dbf96
  Leo Gao authored Jan 05, 2021
  
  2d2dbf96
05 Jan, 2021 1 commit
- Add reminder to rewrite · 08dc67ea
  Leo Gao authored Jan 05, 2021
  
  08dc67ea
05 Oct, 2020 6 commits
- More search and replace · a5c48976
  Leo Gao authored Oct 05, 2020
  
  a5c48976
- Replace HFNLPTask with HFTask everywhere · 6469a0e7
  Leo Gao authored Oct 05, 2020
  
  6469a0e7
- Q/A instead of Question/Answer · 00038fea
  Leo Gao authored Oct 05, 2020
  
  00038fea
- Add WebQs (data only) · 31b2a5dd
  Leo Gao authored Oct 05, 2020
  
  31b2a5dd
- Fix include_target · 6cc21f4b
  Leo Gao authored Oct 05, 2020
  
  6cc21f4b
- Implement ARC · 9e29c2a8
  Leo Gao authored Oct 04, 2020
  
  9e29c2a8