Commits · 8c419c83f2305b73394a98f41b01b0cedbf47351 · gaoqiong / lm-evaluation-harness

26 May, 2023 1 commit
- Fix triviaqa task · 8c419c83
  seopbo authored May 26, 2023
  
  8c419c83
13 Dec, 2022 1 commit
- Bump `triviaqa` version · f7aeeff2
  jon-tow authored Dec 12, 2022
  
  f7aeeff2
03 May, 2022 1 commit
- add pre-commit · 121b7096
  Fabrizio Milo authored May 02, 2022
  
  121b7096
11 Apr, 2022 1 commit
- Fix decontamination queries · ab6883b1
  jon-tow authored Apr 11, 2022
  
  ab6883b1
18 Mar, 2022 1 commit
- Refactor `Task` download · 7c9da714
  Jonathan Tow authored Mar 11, 2022
  
  7c9da714
28 Feb, 2022 2 commits
- Make citations module-level constants · 3f13d15f
  Jonathan Tow authored Feb 28, 2022
  
  3f13d15f
- Add citations and descriptions to all tasks · a1aceacd
  Jonathan Tow authored Feb 28, 2022
  
  a1aceacd
05 Feb, 2022 1 commit
- Added decontamination to remaining evals · dae7b868
  Quentin Gregory Anthony authored Feb 05, 2022
  
  dae7b868
08 Jan, 2022 1 commit
- Actually it shouldn't be hard to fix it to be compatible with future version · c65412e5
  thomasw21 authored Jan 08, 2022
  
  c65412e5
30 Oct, 2021 1 commit
- Replace the `fewshot_description` API with a `description_dict` based interface · 8ac99269
  Jonathan Tow authored Oct 30, 2021
  
  8ac99269
28 Aug, 2021 1 commit
- triviaqa OOM fix · 52f270dc
  Leo Gao authored Aug 27, 2021
  
  52f270dc
10 Jun, 2021 1 commit
- TriviaQA memory fix · efa99cb2
  Leo Gao authored Jun 09, 2021
  
  efa99cb2
05 Jun, 2021 2 commits
- convert all enabled tasks to use best_download for better download robustness · 20229183
  Leo Gao authored Jun 04, 2021
  
  20229183
- Add task versioning · 105fa974
  Leo Gao authored Jun 04, 2021
  
  105fa974
11 Apr, 2021 1 commit
- Fix triviaqa · 5dc4692a
  Leo Gao authored Apr 10, 2021
  
  5dc4692a
10 Apr, 2021 1 commit
- Fix triviaqa memory consumption problem · e971baac
  Leo Gao authored Apr 09, 2021
```
(or rather, move it to the data download phase)
```
  e971baac
27 Mar, 2021 1 commit
- Remove unused imports and format imports · d5d19219
  Jonathan Tow authored Mar 26, 2021
  
  d5d19219
12 Feb, 2021 1 commit
- metrics file · 1fb90b91
  & authored Feb 12, 2021
  
  1fb90b91
03 Feb, 2021 1 commit
- Refactor `Dataset` naming and `HFTask` properties · a60ef6fa
  Jonathan Tow authored Feb 02, 2021
  
  a60ef6fa
01 Feb, 2021 2 commits
- Fix coverage again again again again · 2d6102c4
  Leo Gao authored Feb 01, 2021
  
  2d6102c4
- Fix linting problems · fe4a1efd
  Leo Gao authored Feb 01, 2021
  
  fe4a1efd
30 Jan, 2021 2 commits
- Handle aliases correctly in TriviaQA · b2b5a122
  Leo Gao authored Jan 30, 2021
  
  b2b5a122
- add evaluation for TriviaQA dataset based on loglikelihood · 0601d0bb
  Anthony DiPofi authored Jan 30, 2021
  
  0601d0bb
28 Jan, 2021 1 commit
- Implement unit testing and fix lots of problems with tasks · 60a6fd8c
  Leo Gao authored Jan 27, 2021
  
  60a6fd8c
22 Jan, 2021 2 commits
- Remove rewrite reminder comment from everything except SuperGLUE · f4120e59
  Leo Gao authored Jan 21, 2021
  
  f4120e59
- Clean up code, remove some footguns · e31b4b31
  Leo Gao authored Jan 21, 2021
  
  e31b4b31
13 Jan, 2021 1 commit
- Move `doc_to_text` target code into `doc_to_target` · d77241eb
  Jonathan Tow authored Jan 13, 2021
  
  d77241eb
06 Jan, 2021 1 commit
- Add comments to remind that evaluation needs to be written for the new framework · 2d2dbf96
  Leo Gao authored Jan 05, 2021
  
  2d2dbf96
05 Jan, 2021 1 commit
- Add reminder to rewrite · 08dc67ea
  Leo Gao authored Jan 05, 2021
  
  08dc67ea
24 Oct, 2020 3 commits
- add no target for triviaqa · 171f2924
  Anish Thite authored Oct 24, 2020
  
  171f2924
- update triviaqa download · 0f2b9317
  Anish Thite authored Oct 24, 2020
  
  0f2b9317
- add triviaqa data · 8bfaaa50
  Anish Thite authored Oct 24, 2020
  
  8bfaaa50