Commits · 5f48dfc2ab16917ff5b18862c522bbf42a46f053 · gaoqiong / lm-evaluation-harness

22 Dec, 2021 1 commit
- Add BLiMP · 5f48dfc2
  Igor Ostrovsky authored Dec 21, 2021
  
  5f48dfc2
09 Dec, 2021 3 commits
- Merge pull request #229 from EleutherAI/lm_refactor · df5d7cf0
  Leo Gao authored Dec 08, 2021
```
Refactor LM organization for more reuse
```
  df5d7cf0
- Bump version to 0.1.0 · 9590f366
  Leo Gao authored Dec 08, 2021
  
  9590f366
- Update evaluator.py · c7ae6df1
  Leo Gao authored Dec 08, 2021
  
  c7ae6df1
05 Dec, 2021 3 commits
- Update test_gpt3.py · a6bb79b4
  Leo Gao authored Dec 05, 2021
  
  a6bb79b4
- Update test_gpt3.py · 01b98d2d
  Leo Gao authored Dec 05, 2021
  
  01b98d2d
- Get rid of get_token_logprobs · 7c011370
  Leo Gao authored Dec 05, 2021
  
  7c011370
01 Dec, 2021 1 commit
- Merge pull request #232 from zphang/lm_refactor_update1 · ae63eeb7
  Leo Gao authored Nov 30, 2021
```
Additional clean-up of LM Refactor
```
  ae63eeb7
29 Nov, 2021 7 commits
- Merge pull request #234 from EleutherAI/race_fix · 67e2bf8b
  Leo Gao authored Nov 29, 2021
```
Pin datasets to 1.15.1 to fix RACE
```
  67e2bf8b
- Pin datasets to 1.15.1 · 784a5c54
  Leo Gao authored Nov 28, 2021
  
  784a5c54
- Update req_type to request_type · 6b6e6d77
  Leo Gao authored Nov 28, 2021
  
  6b6e6d77
- Make everything request_type · 3b386db4
  Leo Gao authored Nov 28, 2021
  
  3b386db4
- Update base.py · 24fde4a6
  Leo Gao authored Nov 28, 2021
  
  24fde4a6
- Pin datasets to 1.16.0 · 13916e32
  Leo Gao authored Nov 28, 2021
  
  13916e32
- Merge pull request #228 from jon-tow/truthfulqa-ver-bump · 37bfb4f5
  Leo Gao authored Nov 28, 2021
```
Remove `truthfulqa` dependency on `t5` and bump version
```
  37bfb4f5
28 Nov, 2021 1 commit
- Loosen tolerances that were intended for `float64` values · 376855d5
  Jonathan Tow authored Nov 27, 2021
  
  376855d5
27 Nov, 2021 2 commits
- pytest.approx doesn't support recursive dicts · 377a4fe2
  Leo Gao authored Nov 26, 2021
  
  377a4fe2
- Merge pull request #230 from EleutherAI/losen_reqs · 8a97b28f
  Leo Gao authored Nov 26, 2021
```
Update setup.py
```
  8a97b28f
24 Nov, 2021 2 commits
- update GPT3 test data and more docs · 53f6bc34
  Jason Phang authored Nov 23, 2021
  
  53f6bc34
- Some refactor/clean-up, and GPT-3 update · 76ebb792
  Jason Phang authored Nov 23, 2021
  
  76ebb792
21 Nov, 2021 1 commit
- Add pytest.approx to version_stable · a3d99617
  Leo Gao authored Nov 20, 2021
  
  a3d99617
19 Nov, 2021 2 commits
- Add `truthfulqa` back to the task registry · 33ccde86
  Jonathan Tow authored Nov 19, 2021
  
  33ccde86
- Increase verbosity level of `pytest` · 36edc465
  Jonathan Tow authored Nov 19, 2021
  
  36edc465
18 Nov, 2021 1 commit
- Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness... · e2bbe79a
  Jonathan Tow authored Nov 18, 2021
```
Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness into truthfulqa-ver-bump
```
  e2bbe79a
16 Nov, 2021 1 commit
- Comment out truthfulqa before tests are fixed · 134150a2
  Leo Gao authored Nov 15, 2021
  
  134150a2
06 Nov, 2021 3 commits
- Add newline separator for correct `rougeLsum` · 83252575
  Jonathan Tow authored Nov 06, 2021
  
  83252575
- Update setup.py · 6350d652
  Stella Biderman authored Nov 05, 2021
  
  6350d652
- Revert testdata · 61b14994
  Jonathan Tow authored Nov 05, 2021
  
  61b14994
05 Nov, 2021 4 commits
- Less strict versioning for black · 91e7f182
  Leo Gao authored Nov 05, 2021
  
  91e7f182
- Add imports and fix comment · 2ff1f5a2
  Leo Gao authored Nov 05, 2021
  
  2ff1f5a2
- Switch gpt3 to BaseLM · 8ef7a515
  Leo Gao authored Nov 05, 2021
  
  8ef7a515
- Merge TokenizedLM and TorchLM into BaseLM · fea936e6
  Leo Gao authored Nov 05, 2021
  
  fea936e6
04 Nov, 2021 6 commits
- Remove `t5` imports` · b0746b35
  Jonathan Tow authored Nov 04, 2021
  
  b0746b35
- Fix `rouge-score` version · e2de79da
  Jonathan Tow authored Nov 04, 2021
  
  e2de79da
- Add newline to EOF · e3c74cc0
  Jonathan Tow authored Nov 04, 2021
  
  e3c74cc0
- Merge branch 'truthfulqa-ver-bump' of... · 9e336866
  Jonathan Tow authored Nov 04, 2021
```
Merge branch 'truthfulqa-ver-bump' of https://github.com/jon-tow/lm-evaluation-harness into truthfulqa-ver-bump
```
  9e336866
- Merge branch 'truthfulqa-ver-bump' of... · f123c8cf
  Jonathan Tow authored Nov 04, 2021
```
Merge branch 'truthfulqa-ver-bump' of https://github.com/EleutherAI/lm-evaluation-harness into truthfulqa-ver-bump
```
  f123c8cf
- Remove `t5` dependency · 0f27316c
  Jonathan Tow authored Nov 04, 2021
  
  0f27316c
03 Nov, 2021 2 commits
- Merge remote-tracking branch 'origin/master' into truthfulqa-ver-bump · 4a891f67
  Leo Gao authored Nov 03, 2021
  
  4a891f67
- Pin python version to 3.9.7 · ff8de120
  Leo Gao authored Nov 03, 2021
  
  ff8de120