Commits · 377a4fe2f3c3b972196103e977b268e0ddb92acc · gaoqiong / lm-evaluation-harness

27 Nov, 2021 1 commit
- pytest.approx doesn't support recursive dicts · 377a4fe2
  Leo Gao authored Nov 26, 2021
  
  377a4fe2
21 Nov, 2021 1 commit
- Add pytest.approx to version_stable · a3d99617
  Leo Gao authored Nov 20, 2021
  
  a3d99617
19 Nov, 2021 2 commits
- Add `truthfulqa` back to the task registry · 33ccde86
  Jonathan Tow authored Nov 19, 2021
  
  33ccde86
- Increase verbosity level of `pytest` · 36edc465
  Jonathan Tow authored Nov 19, 2021
  
  36edc465
18 Nov, 2021 1 commit
- Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness... · e2bbe79a
  Jonathan Tow authored Nov 18, 2021
```
Merge branch 'master' of https://github.com/EleutherAI/lm-evaluation-harness into truthfulqa-ver-bump
```
  e2bbe79a
16 Nov, 2021 1 commit
- Comment out truthfulqa before tests are fixed · 134150a2
  Leo Gao authored Nov 15, 2021
  
  134150a2
06 Nov, 2021 2 commits
- Add newline separator for correct `rougeLsum` · 83252575
  Jonathan Tow authored Nov 06, 2021
  
  83252575
- Revert testdata · 61b14994
  Jonathan Tow authored Nov 05, 2021
  
  61b14994
04 Nov, 2021 6 commits
- Remove `t5` imports` · b0746b35
  Jonathan Tow authored Nov 04, 2021
  
  b0746b35
- Fix `rouge-score` version · e2de79da
  Jonathan Tow authored Nov 04, 2021
  
  e2de79da
- Add newline to EOF · e3c74cc0
  Jonathan Tow authored Nov 04, 2021
  
  e3c74cc0
- Merge branch 'truthfulqa-ver-bump' of... · 9e336866
  Jonathan Tow authored Nov 04, 2021
```
Merge branch 'truthfulqa-ver-bump' of https://github.com/jon-tow/lm-evaluation-harness into truthfulqa-ver-bump
```
  9e336866
- Merge branch 'truthfulqa-ver-bump' of... · f123c8cf
  Jonathan Tow authored Nov 04, 2021
```
Merge branch 'truthfulqa-ver-bump' of https://github.com/EleutherAI/lm-evaluation-harness into truthfulqa-ver-bump
```
  f123c8cf
- Remove `t5` dependency · 0f27316c
  Jonathan Tow authored Nov 04, 2021
  
  0f27316c
03 Nov, 2021 6 commits
- Merge remote-tracking branch 'origin/master' into truthfulqa-ver-bump · 4a891f67
  Leo Gao authored Nov 03, 2021
  
  4a891f67
- Pin python version to 3.9.7 · ff8de120
  Leo Gao authored Nov 03, 2021
  
  ff8de120
- Add testdata · a73e80c7
  Leo Gao authored Nov 03, 2021
  
  a73e80c7
- Bump the `truthfulqa` version to 1 · 05ed92a4
  Jonathan Tow authored Nov 03, 2021
  
  05ed92a4
- Merge pull request #225 from JunShern/fix-mkdir-with-parents · 724d728d
  Leo Gao authored Nov 02, 2021
```
Always mkdir with parents
```
  724d728d
- Merge pull request #227 from jon-tow/truthfulqa-dependency-fix · c59bfde8
  Leo Gao authored Nov 02, 2021
```
Update `truthfulqa` dataset checksums
```
  c59bfde8
01 Nov, 2021 7 commits
- Merge remote-tracking branch 'origin/master' into fix-mkdir-with-parents · 3bdba226
  Leo Gao authored Oct 31, 2021
  
  3bdba226
- Merge branch 'master' into truthfulqa-dependency-fix · ddf4339f
  Jonathan Tow authored Nov 01, 2021
  
  ddf4339f
- Pin tensorflow-estimator==2.6.0 · d19c5850
  Leo Gao authored Oct 31, 2021
  
  d19c5850
- Merge remote-tracking branch 'origin/master' into fix-mkdir-with-parents · e8e652d3
  Leo Gao authored Oct 31, 2021
  
  e8e652d3
- Merge remote-tracking branch 'origin/master' into truthfulqa-dependency-fix · 4748281b
  Leo Gao authored Oct 31, 2021
  
  4748281b
- Pin python to 3.9.4 · 53df56d4
  Leo Gao authored Oct 31, 2021
  
  53df56d4
- Remove unused `bleurt` dependency · 84fe796e
  Jonathan Tow authored Nov 01, 2021
  
  84fe796e
31 Oct, 2021 3 commits
- Pin the datasets to the original source · 72257924
  Jonathan Tow authored Oct 30, 2021
  
  72257924
- Clear CI cache · c406a620
  Leo Gao authored Oct 30, 2021
  
  c406a620
- Update `truthfulqa` dataset checksums · 2cfbfd72
  Jonathan Tow authored Oct 30, 2021
  
  2cfbfd72
30 Oct, 2021 1 commit
- Always mkdir with parents · e7dd78ef
  Jun Shern Chan authored Oct 30, 2021
  
  e7dd78ef
28 Oct, 2021 1 commit
- Fix testdata for truthfulqa · 84aa15c6
  Leo Gao authored Oct 27, 2021
  
  84aa15c6
11 Oct, 2021 6 commits
- Update README.md · b67aec37
  Leo Gao authored Oct 11, 2021
  
  b67aec37
- Merge pull request #181 from jon-tow/task-guide · 06d9be66
  Leo Gao authored Oct 11, 2021
```
Add `Task` implementation guide
```
  06d9be66
- Fix spacing issue · fab2a6d8
  Jonathan Tow authored Oct 11, 2021
  
  fab2a6d8
- Re-order sections and adjust header structure · de7d6614
  Jonathan Tow authored Oct 11, 2021
  
  de7d6614
- Update task-guide.md · a5541c02
  Leo Gao authored Oct 11, 2021
  
  a5541c02
- Update task-guide.md · cf8da970
  Leo Gao authored Oct 11, 2021
  
  cf8da970
07 Oct, 2021 2 commits
- Merge pull request #219 from jon-tow/truthfulqa · 33a94c54
  Leo Gao authored Oct 06, 2021
```
Implement `TruthfulQA`
```
  33a94c54
- Add underscores to metrics · 85ffb7fc
  Leo Gao authored Oct 06, 2021
  
  85ffb7fc