Commits · f079e322b857714fcef1ada9e78ddc606fe51e84 · gaoqiong / lm-evaluation-harness

11 Jan, 2023 1 commit

Tom Hartvigsen authored Jan 10, 2023

* added toxigen task

* removed previous doc_to_text

* Add train split for few-shot samples

* Add task version metadata

f079e322

13 Dec, 2022 1 commit
- Bump `triviaqa` version · f7aeeff2
  jon-tow authored Dec 12, 2022
  
  f7aeeff2
02 Dec, 2022 1 commit
- Cleanup `README.md` and package deps · 0699d774
  jon-tow authored Dec 02, 2022
  
  0699d774
25 Nov, 2022 1 commit
- Add the original `LAMBADA` dataset · bfa57687
  jon-tow authored Nov 24, 2022
  
  bfa57687
04 Nov, 2022 1 commit
- Add `TextSynth` API (#299) · 4f0410a4
  Jonathan Tow authored Nov 03, 2022
```
* Add `TextSynth` API
```
  4f0410a4
03 May, 2022 2 commits
- Revert `tests/testdata` changes and address flake8 issues · 8c997e53
  jon-tow authored May 03, 2022
  
  8c997e53
- add pre-commit · 121b7096
  Fabrizio Milo authored May 02, 2022
  
  121b7096
12 Apr, 2022 1 commit
- Add testdata · 9b6c45a8
  jon-tow authored Apr 12, 2022
  
  9b6c45a8
17 Feb, 2022 1 commit
- Add `gsm8k` test data · 54065e6a
  Jonathan Tow authored Feb 17, 2022
  
  54065e6a
06 Feb, 2022 1 commit
- Bump Hendrycks `MATH` because of updated dataset · 49dc29bd
  Jonathan Tow authored Feb 06, 2022
  
  49dc29bd
15 Jan, 2022 1 commit
- cb: add testdata · 1c52e917
  Leo Gao authored Jan 14, 2022
  
  1c52e917
01 Jan, 2022 1 commit
- pile/wikitext: add testdata · 33315a1f
  Leo Gao authored Dec 31, 2021
  
  33315a1f
29 Dec, 2021 2 commits
- Add testdata for multirc v1 · 73d0ae5e
  thomasw21 authored Dec 29, 2021
  
  73d0ae5e
- Add testdata for boolq v1 · f42a8d66
  thomasw21 authored Dec 29, 2021
  
  f42a8d66
24 Dec, 2021 2 commits
- wnli: add testdata for v1 · 66fffcfc
  Leo Gao authored Dec 23, 2021
  
  66fffcfc
- Add new testdata · 22c4124f
  Leo Gao authored Dec 23, 2021
  
  22c4124f
24 Nov, 2021 1 commit
- update GPT3 test data and more docs · 53f6bc34
  Jason Phang authored Nov 23, 2021
  
  53f6bc34
06 Nov, 2021 1 commit
- Revert testdata · 61b14994
  Jonathan Tow authored Nov 05, 2021
  
  61b14994
03 Nov, 2021 1 commit
- Add testdata · a73e80c7
  Leo Gao authored Nov 03, 2021
  
  a73e80c7
28 Oct, 2021 1 commit
- Fix testdata for truthfulqa · 84aa15c6
  Leo Gao authored Oct 27, 2021
  
  84aa15c6
07 Oct, 2021 1 commit
- Add underscores to metrics · 85ffb7fc
  Leo Gao authored Oct 06, 2021
  
  85ffb7fc
06 Oct, 2021 1 commit
- Add truthfulqa test data · 0538d4c9
  Leo Gao authored Oct 06, 2021
  
  0538d4c9
01 Sep, 2021 1 commit
- Add MT lambada multilingual testdata · b50b1ffd
  Leo Gao authored Sep 01, 2021
  
  b50b1ffd
27 Aug, 2021 1 commit
- Add zh/ja v1 data · e4766cd7
  Leo Gao authored Aug 26, 2021
  
  e4766cd7
13 Aug, 2021 1 commit
- Update version and testdata for DROP · 81122e3d
  Leo Gao authored Aug 13, 2021
  
  81122e3d
09 Aug, 2021 1 commit
- fix squad breakage due to HF change · 198ca732
  Leo Gao authored Aug 09, 2021
  
  198ca732
20 Jun, 2021 3 commits
- Add mutual v1 test data · 0fec4555
  Leo Gao authored Jun 20, 2021
  
  0fec4555
- Add MC-TACO stable test data · 9676b93f
  Leo Gao authored Jun 19, 2021
  
  9676b93f
- Add MuTual test data · 3e1bcf71
  Leo Gao authored Jun 19, 2021
  
  3e1bcf71
12 Jun, 2021 1 commit
- Update test data for coqa v1 · 41b0ae22
  Leo Gao authored Jun 11, 2021
  
  41b0ae22
10 Jun, 2021 3 commits
- Add gpt3 tests · c59cd334
  Leo Gao authored Jun 10, 2021
  
  c59cd334
- Add stable version hash for prost · 6e5b3cde
  Leo Gao authored Jun 10, 2021
  
  6e5b3cde
- Use hashed version stability test instead · f9cc0267
  Leo Gao authored Jun 10, 2021
  
  f9cc0267
08 Jun, 2021 1 commit
- make hendrycks math order deterministic · 3b990af0
  Leo Gao authored Jun 07, 2021
  
  3b990af0
05 Jun, 2021 1 commit
- Add tests to make sure task definitions don't change without the version also changing · 17c825d1
  Leo Gao authored Jun 04, 2021
  
  17c825d1