Commits · 1f8a8c1dc95a475f0b6fd3cc082e89a674c072d7 · gaoqiong / lm-evaluation-harness

11 Jun, 2022 1 commit
- Remove custom datasets that are in HF · b4c0275d
  jon-tow authored Jun 11, 2022
  
  b4c0275d
03 May, 2022 2 commits
- Revert `tests/testdata` changes and address flake8 issues · 8c997e53
  jon-tow authored May 03, 2022
  
  8c997e53
- add pre-commit · 121b7096
  Fabrizio Milo authored May 02, 2022
  
  121b7096
18 Mar, 2022 1 commit
- Refactor `Task` download · 7c9da714
  Jonathan Tow authored Mar 11, 2022
  
  7c9da714
28 Feb, 2022 2 commits
- Make citations module-level constants · 3f13d15f
  Jonathan Tow authored Feb 28, 2022
  
  3f13d15f
- Add citations and descriptions to all tasks · a1aceacd
  Jonathan Tow authored Feb 28, 2022
  
  a1aceacd
05 Feb, 2022 1 commit
- Added decontamination to remaining evals · dae7b868
  Quentin Gregory Anthony authored Feb 05, 2022
  
  dae7b868
08 Jan, 2022 1 commit
- Actually it shouldn't be hard to fix it to be compatible with future version · c65412e5
  thomasw21 authored Jan 08, 2022
  
  c65412e5
24 Dec, 2021 1 commit
- Remove all `provide_description` argument uses · 57d0718a
  Jonathan Tow authored Dec 24, 2021
  
  57d0718a
21 Dec, 2021 2 commits
- Format for consistency · aea963a1
  Jonathan Tow authored Dec 21, 2021
  
  aea963a1
- Add positional arg deprecation decorator · 8ebe36b2
  Jonathan Tow authored Dec 21, 2021
  
  8ebe36b2
16 Dec, 2021 1 commit
- Add `provide_description` arg for backward compat · ee53be21
  Jonathan Tow authored Dec 15, 2021
  
  ee53be21
06 Nov, 2021 1 commit
- Add newline separator for correct `rougeLsum` · 83252575
  Jonathan Tow authored Nov 06, 2021
  
  83252575
04 Nov, 2021 3 commits
- Remove `t5` imports` · b0746b35
  Jonathan Tow authored Nov 04, 2021
  
  b0746b35
- Add newline to EOF · e3c74cc0
  Jonathan Tow authored Nov 04, 2021
  
  e3c74cc0
- Remove `t5` dependency · 0f27316c
  Jonathan Tow authored Nov 04, 2021
  
  0f27316c
03 Nov, 2021 1 commit
- Bump the `truthfulqa` version to 1 · 05ed92a4
  Jonathan Tow authored Nov 03, 2021
  
  05ed92a4
31 Oct, 2021 2 commits
- Pin the datasets to the original source · 72257924
  Jonathan Tow authored Oct 30, 2021
  
  72257924
- Update `truthfulqa` dataset checksums · 2cfbfd72
  Jonathan Tow authored Oct 30, 2021
  
  2cfbfd72
30 Oct, 2021 1 commit
- Replace the `fewshot_description` API with a `description_dict` based interface · 8ac99269
  Jonathan Tow authored Oct 30, 2021
  
  8ac99269
07 Oct, 2021 1 commit
- Add underscores to metrics · 85ffb7fc
  Leo Gao authored Oct 06, 2021
  
  85ffb7fc
06 Oct, 2021 1 commit
- Adhere to spacing convention · dd59b0ef
  Jonathan Tow authored Oct 06, 2021
  
  dd59b0ef
25 Sep, 2021 1 commit
- Implement `TruthfulQA` · 17c47812
  Jonathan Tow authored Sep 24, 2021
  
  17c47812