Commits · 9e5acd1df75fa12adfd56479afa1ccf5d6d5faf9 · gaoqiong / lm-evaluation-harness

17 Aug, 2023 2 commits
- Updated NQOpen documentation · 9e5acd1d
  Björn Bebensee authored Aug 17, 2023
  
  9e5acd1d
- Added NQ-Open task · a28c03e6
  Björn Bebensee authored Aug 17, 2023
  
  a28c03e6
03 May, 2022 2 commits
- Revert `tests/testdata` changes and address flake8 issues · 8c997e53
  jon-tow authored May 03, 2022
  
  8c997e53
- add pre-commit · 121b7096
  Fabrizio Milo authored May 02, 2022
  
  121b7096
18 Mar, 2022 1 commit
- Refactor `Task` download · 7c9da714
  Jonathan Tow authored Mar 11, 2022
  
  7c9da714
28 Feb, 2022 2 commits
- Make citations module-level constants · 3f13d15f
  Jonathan Tow authored Feb 28, 2022
  
  3f13d15f
- Add citations and descriptions to all tasks · a1aceacd
  Jonathan Tow authored Feb 28, 2022
  
  a1aceacd
05 Feb, 2022 1 commit
- Added decontamination to remaining evals · dae7b868
  Quentin Gregory Anthony authored Feb 05, 2022
  
  dae7b868
30 Oct, 2021 1 commit
- Replace the `fewshot_description` API with a `description_dict` based interface · 8ac99269
  Jonathan Tow authored Oct 30, 2021
  
  8ac99269
05 Jun, 2021 1 commit
- Add task versioning · 105fa974
  Leo Gao authored Jun 04, 2021
  
  105fa974
16 May, 2021 1 commit
- naturalqs: fix spacing · 9c76176b
  Leo Gao authored May 15, 2021
  
  9c76176b
27 Mar, 2021 2 commits
- Remove unused imports and format imports · d5d19219
  Jonathan Tow authored Mar 26, 2021
  
  d5d19219
- Pass random state around to fewshot_examples and fewshot_context · 3b2d5f6c
  Leo Gao authored Mar 26, 2021
  
  3b2d5f6c
26 Mar, 2021 1 commit
- naturalqs: update random · d7b20fe2
  Leo Gao authored Mar 25, 2021
  
  d7b20fe2
03 Feb, 2021 2 commits
- Fix naming convention to avoid `pytest` name mangling invocation · 5cfb7308
  Jonathan Tow authored Feb 02, 2021
  
  5cfb7308
- Refactor `Dataset` naming and `HFTask` properties · a60ef6fa
  Jonathan Tow authored Feb 02, 2021
  
  a60ef6fa
01 Feb, 2021 3 commits
- Fix coverage again again again again · 2d6102c4
  Leo Gao authored Feb 01, 2021
  
  2d6102c4
- Make linter happy · 31863cde
  Leo Gao authored Feb 01, 2021
  
  31863cde
- Fix linting problems · fe4a1efd
  Leo Gao authored Feb 01, 2021
  
  fe4a1efd
22 Jan, 2021 2 commits
- Remove rewrite reminder comment from everything except SuperGLUE · f4120e59
  Leo Gao authored Jan 21, 2021
  
  f4120e59
- Clean up code, remove some footguns · e31b4b31
  Leo Gao authored Jan 21, 2021
  
  e31b4b31
13 Jan, 2021 1 commit
- Move `doc_to_text` target code into `doc_to_target` · d77241eb
  Jonathan Tow authored Jan 13, 2021
  
  d77241eb
06 Jan, 2021 1 commit
- Add comments to remind that evaluation needs to be written for the new framework · 2d2dbf96
  Leo Gao authored Jan 05, 2021
  
  2d2dbf96
05 Jan, 2021 1 commit
- Add reminder to rewrite · 08dc67ea
  Leo Gao authored Jan 05, 2021
  
  08dc67ea
30 Nov, 2020 2 commits
- Add missing import · cf69ba9c
  Leo Gao authored Nov 30, 2020
  
  cf69ba9c
- Make fewshot_examples fast · 6de520af
  Leo Gao authored Nov 30, 2020
  
  6de520af
24 Oct, 2020 6 commits
- Fixes to natural questions. · c013679d
  Charles Foster authored Oct 24, 2020
  
  c013679d
- Updates to natural questions answer handling. Now uses long answers alwasy. · dc3560d0
  Charles Foster authored Oct 24, 2020
  
  dc3560d0
- Small typos · d51f3e7f
  Charles Foster authored Oct 24, 2020
  
  d51f3e7f
- Updates to natural questions to deal with memory issues. · 9291edaa
  Charles Foster authored Oct 24, 2020
  
  9291edaa
- Removed apache_beam dependency. · 0dda9f63
  Charles Foster authored Oct 24, 2020
  
  0dda9f63
- Added natural questions. Not yet validated or tested with a call to write. · 9426db16
  Charles Foster authored Oct 23, 2020
  
  9426db16