Commits · a34bbe695d8da0eaf8e488b082efd8ad1ffe1745 · gaoqiong / lm-evaluation-harness

24 Dec, 2021 1 commit
- Remove more `provide_description` uses · a34bbe69
  Jonathan Tow authored Dec 24, 2021
  
  a34bbe69
21 Dec, 2021 1 commit
- Add positional arg deprecation decorator · 8ebe36b2
  Jonathan Tow authored Dec 21, 2021
  
  8ebe36b2
16 Dec, 2021 5 commits
- Remove needless call · e3ddcfc2
  Jonathan Tow authored Dec 16, 2021
  
  e3ddcfc2
- Add newline to end of file · d1319950
  Jonathan Tow authored Dec 15, 2021
  
  d1319950
- Remove `print` from test · 3fdff22f
  Jonathan Tow authored Dec 15, 2021
  
  3fdff22f
- Add basic `description_dict` · d7a8ab24
  Jonathan Tow authored Dec 15, 2021
```
test
```
  d7a8ab24
- Add `provide_description` arg for backward compat · ee53be21
  Jonathan Tow authored Dec 15, 2021
  
  ee53be21
05 Dec, 2021 2 commits
- Update test_gpt3.py · a6bb79b4
  Leo Gao authored Dec 05, 2021
  
  a6bb79b4
- Update test_gpt3.py · 01b98d2d
  Leo Gao authored Dec 05, 2021
  
  01b98d2d
28 Nov, 2021 1 commit
- Loosen tolerances that were intended for `float64` values · 376855d5
  Jonathan Tow authored Nov 27, 2021
  
  376855d5
27 Nov, 2021 1 commit
- pytest.approx doesn't support recursive dicts · 377a4fe2
  Leo Gao authored Nov 26, 2021
  
  377a4fe2
24 Nov, 2021 2 commits
- update GPT3 test data and more docs · 53f6bc34
  Jason Phang authored Nov 23, 2021
  
  53f6bc34
- Some refactor/clean-up, and GPT-3 update · 76ebb792
  Jason Phang authored Nov 23, 2021
  
  76ebb792
21 Nov, 2021 1 commit
- Add pytest.approx to version_stable · a3d99617
  Leo Gao authored Nov 20, 2021
  
  a3d99617
06 Nov, 2021 1 commit
- Revert testdata · 61b14994
  Jonathan Tow authored Nov 05, 2021
  
  61b14994
03 Nov, 2021 1 commit
- Add testdata · a73e80c7
  Leo Gao authored Nov 03, 2021
  
  a73e80c7
30 Oct, 2021 1 commit
- Replace the `fewshot_description` API with a `description_dict` based interface · 8ac99269
  Jonathan Tow authored Oct 30, 2021
  
  8ac99269
28 Oct, 2021 1 commit
- Fix testdata for truthfulqa · 84aa15c6
  Leo Gao authored Oct 27, 2021
  
  84aa15c6
11 Oct, 2021 1 commit
- Refactor LM organization for more reuse · 7f24a08b
  Leo Gao authored Oct 11, 2021
  
  7f24a08b
07 Oct, 2021 1 commit
- Add underscores to metrics · 85ffb7fc
  Leo Gao authored Oct 06, 2021
  
  85ffb7fc
06 Oct, 2021 1 commit
- Add truthfulqa test data · 0538d4c9
  Leo Gao authored Oct 06, 2021
  
  0538d4c9
01 Sep, 2021 1 commit
- Add MT lambada multilingual testdata · b50b1ffd
  Leo Gao authored Sep 01, 2021
  
  b50b1ffd
28 Aug, 2021 1 commit
- triviaqa OOM fix · 52f270dc
  Leo Gao authored Aug 27, 2021
  
  52f270dc
27 Aug, 2021 1 commit
- Add zh/ja v1 data · e4766cd7
  Leo Gao authored Aug 26, 2021
  
  e4766cd7
13 Aug, 2021 1 commit
- Update version and testdata for DROP · 81122e3d
  Leo Gao authored Aug 13, 2021
  
  81122e3d
09 Aug, 2021 1 commit
- fix squad breakage due to HF change · 198ca732
  Leo Gao authored Aug 09, 2021
  
  198ca732
20 Jun, 2021 3 commits
- Add mutual v1 test data · 0fec4555
  Leo Gao authored Jun 20, 2021
  
  0fec4555
- Add MC-TACO stable test data · 9676b93f
  Leo Gao authored Jun 19, 2021
  
  9676b93f
- Add MuTual test data · 3e1bcf71
  Leo Gao authored Jun 19, 2021
  
  3e1bcf71
14 Jun, 2021 1 commit
- Fix typo · 0f4e3df4
  Leo Gao authored Jun 13, 2021
  
  0f4e3df4
12 Jun, 2021 3 commits
- Test training docs too and don't cache downloads · 893ef63f
  Leo Gao authored Jun 12, 2021
  
  893ef63f
- Look at all docs of task in test · 7cbd0bba
  Leo Gao authored Jun 12, 2021
  
  7cbd0bba
- Update test data for coqa v1 · 41b0ae22
  Leo Gao authored Jun 11, 2021
  
  41b0ae22
11 Jun, 2021 1 commit
- Set dummy secret key · 7069583b
  Leo Gao authored Jun 10, 2021
  
  7069583b
10 Jun, 2021 3 commits
- Add gpt3 tests · c59cd334
  Leo Gao authored Jun 10, 2021
  
  c59cd334
- Add stable version hash for prost · 6e5b3cde
  Leo Gao authored Jun 10, 2021
  
  6e5b3cde
- Use hashed version stability test instead · f9cc0267
  Leo Gao authored Jun 10, 2021
  
  f9cc0267
08 Jun, 2021 1 commit
- make hendrycks math order deterministic · 3b990af0
  Leo Gao authored Jun 07, 2021
  
  3b990af0
05 Jun, 2021 2 commits
- Add tests to make sure task definitions don't change without the version also changing · 17c825d1
  Leo Gao authored Jun 04, 2021
  
  17c825d1
- Add task versioning · 105fa974
  Leo Gao authored Jun 04, 2021
  
  105fa974