Commits · 49dc29bdfc857f59dfc46b425e3533a814424d91 · gaoqiong / lm-evaluation-harness

06 Feb, 2022 1 commit
- Bump Hendrycks `MATH` because of updated dataset · 49dc29bd
  Jonathan Tow authored Feb 06, 2022
  
  49dc29bd
15 Jan, 2022 1 commit
- cb: add testdata · 1c52e917
  Leo Gao authored Jan 14, 2022
  
  1c52e917
03 Jan, 2022 2 commits
- Delete test_cache.db · 9d87d476
  Leo Gao authored Jan 03, 2022
  
  9d87d476
- Improve pile test efficiency · cb3babd3
  Leo Gao authored Jan 03, 2022
  
  cb3babd3
01 Jan, 2022 1 commit
- pile/wikitext: add testdata · 33315a1f
  Leo Gao authored Dec 31, 2021
  
  33315a1f
29 Dec, 2021 2 commits
- Add testdata for multirc v1 · 73d0ae5e
  thomasw21 authored Dec 29, 2021
  
  73d0ae5e
- Add testdata for boolq v1 · f42a8d66
  thomasw21 authored Dec 29, 2021
  
  f42a8d66
24 Dec, 2021 3 commits
- Remove more `provide_description` uses · a34bbe69
  Jonathan Tow authored Dec 24, 2021
  
  a34bbe69
- wnli: add testdata for v1 · 66fffcfc
  Leo Gao authored Dec 23, 2021
  
  66fffcfc
- Add new testdata · 22c4124f
  Leo Gao authored Dec 23, 2021
  
  22c4124f
22 Dec, 2021 1 commit
- Add BLiMP · 5f48dfc2
  Igor Ostrovsky authored Dec 21, 2021
  
  5f48dfc2
21 Dec, 2021 1 commit
- Add positional arg deprecation decorator · 8ebe36b2
  Jonathan Tow authored Dec 21, 2021
  
  8ebe36b2
16 Dec, 2021 5 commits
- Remove needless call · e3ddcfc2
  Jonathan Tow authored Dec 16, 2021
  
  e3ddcfc2
- Add newline to end of file · d1319950
  Jonathan Tow authored Dec 15, 2021
  
  d1319950
- Remove `print` from test · 3fdff22f
  Jonathan Tow authored Dec 15, 2021
  
  3fdff22f
- Add basic `description_dict` · d7a8ab24
  Jonathan Tow authored Dec 15, 2021
```
test
```
  d7a8ab24
- Add `provide_description` arg for backward compat · ee53be21
  Jonathan Tow authored Dec 15, 2021
  
  ee53be21
05 Dec, 2021 2 commits
- Update test_gpt3.py · a6bb79b4
  Leo Gao authored Dec 05, 2021
  
  a6bb79b4
- Update test_gpt3.py · 01b98d2d
  Leo Gao authored Dec 05, 2021
  
  01b98d2d
28 Nov, 2021 1 commit
- Loosen tolerances that were intended for `float64` values · 376855d5
  Jonathan Tow authored Nov 27, 2021
  
  376855d5
27 Nov, 2021 1 commit
- pytest.approx doesn't support recursive dicts · 377a4fe2
  Leo Gao authored Nov 26, 2021
  
  377a4fe2
24 Nov, 2021 2 commits
- update GPT3 test data and more docs · 53f6bc34
  Jason Phang authored Nov 23, 2021
  
  53f6bc34
- Some refactor/clean-up, and GPT-3 update · 76ebb792
  Jason Phang authored Nov 23, 2021
  
  76ebb792
21 Nov, 2021 1 commit
- Add pytest.approx to version_stable · a3d99617
  Leo Gao authored Nov 20, 2021
  
  a3d99617
06 Nov, 2021 1 commit
- Revert testdata · 61b14994
  Jonathan Tow authored Nov 05, 2021
  
  61b14994
03 Nov, 2021 1 commit
- Add testdata · a73e80c7
  Leo Gao authored Nov 03, 2021
  
  a73e80c7
30 Oct, 2021 1 commit
- Replace the `fewshot_description` API with a `description_dict` based interface · 8ac99269
  Jonathan Tow authored Oct 30, 2021
  
  8ac99269
28 Oct, 2021 1 commit
- Fix testdata for truthfulqa · 84aa15c6
  Leo Gao authored Oct 27, 2021
  
  84aa15c6
11 Oct, 2021 1 commit
- Refactor LM organization for more reuse · 7f24a08b
  Leo Gao authored Oct 11, 2021
  
  7f24a08b
07 Oct, 2021 1 commit
- Add underscores to metrics · 85ffb7fc
  Leo Gao authored Oct 06, 2021
  
  85ffb7fc
06 Oct, 2021 1 commit
- Add truthfulqa test data · 0538d4c9
  Leo Gao authored Oct 06, 2021
  
  0538d4c9
01 Sep, 2021 1 commit
- Add MT lambada multilingual testdata · b50b1ffd
  Leo Gao authored Sep 01, 2021
  
  b50b1ffd
28 Aug, 2021 1 commit
- triviaqa OOM fix · 52f270dc
  Leo Gao authored Aug 27, 2021
  
  52f270dc
27 Aug, 2021 1 commit
- Add zh/ja v1 data · e4766cd7
  Leo Gao authored Aug 26, 2021
  
  e4766cd7
13 Aug, 2021 1 commit
- Update version and testdata for DROP · 81122e3d
  Leo Gao authored Aug 13, 2021
  
  81122e3d
09 Aug, 2021 1 commit
- fix squad breakage due to HF change · 198ca732
  Leo Gao authored Aug 09, 2021
  
  198ca732
20 Jun, 2021 3 commits
- Add mutual v1 test data · 0fec4555
  Leo Gao authored Jun 20, 2021
  
  0fec4555
- Add MC-TACO stable test data · 9676b93f
  Leo Gao authored Jun 19, 2021
  
  9676b93f
- Add MuTual test data · 3e1bcf71
  Leo Gao authored Jun 19, 2021
  
  3e1bcf71
14 Jun, 2021 1 commit
- Fix typo · 0f4e3df4
  Leo Gao authored Jun 13, 2021
  
  0f4e3df4