Commits · 1bc6cdb160efa0bbc3198a15d2cf428a06158aec · gaoqiong / lm-evaluation-harness

"vscode:/vscode.git/clone" did not exist on "cb00a19603dd59ca6682d113d0c9111036eab418"

16 Dec, 2021 12 commits
- Add type info to doc-string · 1bc6cdb1
  Jonathan Tow authored Dec 16, 2021
  
  1bc6cdb1
- Fix task example link · 744482bb
  Jonathan Tow authored Dec 16, 2021
  
  744482bb
- Fix task example link · e54380d8
  Jonathan Tow authored Dec 16, 2021
  
  e54380d8
- Remove unused import · 3f06b603
  Jonathan Tow authored Dec 16, 2021
  
  3f06b603
- Fix assertion error message · 09e1de93
  Jonathan Tow authored Dec 16, 2021
  
  09e1de93
- Remove needless call · e3ddcfc2
  Jonathan Tow authored Dec 16, 2021
  
  e3ddcfc2
- Make `evaluate` and `simple_evaluate` description args consistent · 10dd7d38
  Jonathan Tow authored Dec 15, 2021
  
  10dd7d38
- Add newline to end of file · d1319950
  Jonathan Tow authored Dec 15, 2021
  
  d1319950
- Fix assertion error string · 09cd76c7
  Jonathan Tow authored Dec 15, 2021
  
  09cd76c7
- Remove `print` from test · 3fdff22f
  Jonathan Tow authored Dec 15, 2021
  
  3fdff22f
- Add basic `description_dict` · d7a8ab24
  Jonathan Tow authored Dec 15, 2021
```
test
```
  d7a8ab24
- Add `provide_description` arg for backward compat · ee53be21
  Jonathan Tow authored Dec 15, 2021
  
  ee53be21
15 Dec, 2021 3 commits
- Merge branch 'evaluator-description-option' of... · 7a357971
  Jonathan Tow authored Dec 15, 2021
```
Merge branch 'evaluator-description-option' of https://github.com/jon-tow/lm-evaluation-harness into evaluator-description-option
```
  7a357971
- Merge · 1d04c42d
  Jonathan Tow authored Dec 15, 2021
  
  1d04c42d
- Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness... · ff314d62
  Jonathan Tow authored Dec 15, 2021
```
Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness into evaluator-description-option
```
  ff314d62
09 Dec, 2021 3 commits
- Merge pull request #229 from EleutherAI/lm_refactor · df5d7cf0
  Leo Gao authored Dec 08, 2021
```
Refactor LM organization for more reuse
```
  df5d7cf0
- Bump version to 0.1.0 · 9590f366
  Leo Gao authored Dec 08, 2021
  
  9590f366
- Update evaluator.py · c7ae6df1
  Leo Gao authored Dec 08, 2021
  
  c7ae6df1
06 Dec, 2021 1 commit
- Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness... · 564e0612
  Jonathan Tow authored Dec 06, 2021
```
Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness into evaluator-description-option
```
  564e0612
05 Dec, 2021 3 commits
- Update test_gpt3.py · a6bb79b4
  Leo Gao authored Dec 05, 2021
  
  a6bb79b4
- Update test_gpt3.py · 01b98d2d
  Leo Gao authored Dec 05, 2021
  
  01b98d2d
- Get rid of get_token_logprobs · 7c011370
  Leo Gao authored Dec 05, 2021
  
  7c011370
01 Dec, 2021 1 commit
- Merge pull request #232 from zphang/lm_refactor_update1 · ae63eeb7
  Leo Gao authored Nov 30, 2021
```
Additional clean-up of LM Refactor
```
  ae63eeb7
29 Nov, 2021 7 commits
- Merge pull request #234 from EleutherAI/race_fix · 67e2bf8b
  Leo Gao authored Nov 29, 2021
```
Pin datasets to 1.15.1 to fix RACE
```
  67e2bf8b
- Pin datasets to 1.15.1 · 784a5c54
  Leo Gao authored Nov 28, 2021
  
  784a5c54
- Update req_type to request_type · 6b6e6d77
  Leo Gao authored Nov 28, 2021
  
  6b6e6d77
- Make everything request_type · 3b386db4
  Leo Gao authored Nov 28, 2021
  
  3b386db4
- Update base.py · 24fde4a6
  Leo Gao authored Nov 28, 2021
  
  24fde4a6
- Pin datasets to 1.16.0 · 13916e32
  Leo Gao authored Nov 28, 2021
  
  13916e32
- Merge pull request #228 from jon-tow/truthfulqa-ver-bump · 37bfb4f5
  Leo Gao authored Nov 28, 2021
```
Remove `truthfulqa` dependency on `t5` and bump version
```
  37bfb4f5
28 Nov, 2021 1 commit
- Loosen tolerances that were intended for `float64` values · 376855d5
  Jonathan Tow authored Nov 27, 2021
  
  376855d5
27 Nov, 2021 2 commits
- pytest.approx doesn't support recursive dicts · 377a4fe2
  Leo Gao authored Nov 26, 2021
  
  377a4fe2
- Merge pull request #230 from EleutherAI/losen_reqs · 8a97b28f
  Leo Gao authored Nov 26, 2021
```
Update setup.py
```
  8a97b28f
24 Nov, 2021 2 commits
- update GPT3 test data and more docs · 53f6bc34
  Jason Phang authored Nov 23, 2021
  
  53f6bc34
- Some refactor/clean-up, and GPT-3 update · 76ebb792
  Jason Phang authored Nov 23, 2021
  
  76ebb792
21 Nov, 2021 1 commit
- Add pytest.approx to version_stable · a3d99617
  Leo Gao authored Nov 20, 2021
  
  a3d99617
19 Nov, 2021 2 commits
- Add `truthfulqa` back to the task registry · 33ccde86
  Jonathan Tow authored Nov 19, 2021
  
  33ccde86
- Increase verbosity level of `pytest` · 36edc465
  Jonathan Tow authored Nov 19, 2021
  
  36edc465
18 Nov, 2021 1 commit
- Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness... · e2bbe79a
  Jonathan Tow authored Nov 18, 2021
```
Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness into truthfulqa-ver-bump
```
  e2bbe79a
16 Nov, 2021 1 commit
- Comment out truthfulqa before tests are fixed · 134150a2
  Leo Gao authored Nov 15, 2021
  
  134150a2