Commits · 7cbd0bba4aab4e8f90583e77123126f01e562fe7 · gaoqiong / lm-evaluation-harness

12 Jun, 2021 6 commits
- Look at all docs of task in test · 7cbd0bba
  Leo Gao authored Jun 12, 2021
  
  7cbd0bba
- Merge pull request #195 from EleutherAI/sdtblck-patch-1 · dc648d84
  Leo Gao authored Jun 12, 2021
```
Change generate until sequence in coqa to be \nQ:
```
  dc648d84
- Update test data for coqa v1 · 41b0ae22
  Leo Gao authored Jun 11, 2021
  
  41b0ae22
- Actually do things correctly this time · f14571fb
  Leo Gao authored Jun 11, 2021
  
  f14571fb
- Bump CoQA version · 278863b5
  Leo Gao authored Jun 11, 2021
  
  278863b5
- Make CoQA take the first line of output excluding any leading whitespace · 2078adba
  Leo Gao authored Jun 11, 2021
  
  2078adba
11 Jun, 2021 1 commit
- Set dummy secret key · 7069583b
  Leo Gao authored Jun 10, 2021
  
  7069583b
10 Jun, 2021 13 commits
- Add openai dependency · 21a1178c
  Leo Gao authored Jun 10, 2021
  
  21a1178c
- Add gpt3 tests · c59cd334
  Leo Gao authored Jun 10, 2021
  
  c59cd334
- Change generate until sequence in coqa to be \nQ: · cc474a94
  sdtblck authored Jun 11, 2021
  
  cc474a94
- Exclude abstractmethod and notimplemented stuff from coverage · 9b9d8dd7
  Leo Gao authored Jun 10, 2021
  
  9b9d8dd7
- Remove a bunch of dead code · 8f8a1dff
  Leo Gao authored Jun 10, 2021
  
  8f8a1dff
- Add stable version hash for prost · 6e5b3cde
  Leo Gao authored Jun 10, 2021
  
  6e5b3cde
- Merge pull request #194 from jon-tow/prost-task · 51a567cf
  Leo Gao authored Jun 10, 2021
```
Implement `PROST` task
```
  51a567cf
- Implement `PROST` task · f4e38081
  Jonathan Tow authored Jun 10, 2021
  
  f4e38081
- Use hashed version stability test instead · f9cc0267
  Leo Gao authored Jun 10, 2021
  
  f9cc0267
- Minor WikiText fix · 10d4b64a
  Leo Gao authored Jun 09, 2021
  
  10d4b64a
- Implement WikiText · 5e31e40e
  Leo Gao authored Jun 09, 2021
  
  5e31e40e
- TriviaQA memory fix · efa99cb2
  Leo Gao authored Jun 09, 2021
  
  efa99cb2
- Omit unimplemented tasks from coverage · c4ecbd6d
  Leo Gao authored Jun 09, 2021
  
  c4ecbd6d
09 Jun, 2021 1 commit
- Update README.md · 142ee24f
  Leo Gao authored Jun 08, 2021
  
  142ee24f
08 Jun, 2021 5 commits
- Make codecov use token · 04a81391
  Leo Gao authored Jun 08, 2021
  
  04a81391
- Rename CI pipeline · e87200ed
  Leo Gao authored Jun 07, 2021
  
  e87200ed
- Fix broken coverage · f685cecf
  Leo Gao authored Jun 07, 2021
  
  f685cecf
- make hendrycks math order deterministic · 3b990af0
  Leo Gao authored Jun 07, 2021
  
  3b990af0
- Actually fix hendrycks math · 90429563
  Leo Gao authored Jun 07, 2021
  
  90429563
07 Jun, 2021 2 commits
- Merge branch 'master' of github.com:EleutherAI/lm_evaluation_harness · 2810c634
  Leo Gao authored Jun 07, 2021
  
  2810c634
- Fix hendrycks MATH to use new download link · 004b63e3
  Leo Gao authored Jun 07, 2021
  
  004b63e3
06 Jun, 2021 3 commits
- Update README.md · 54efc9cd
  Leo Gao authored Jun 06, 2021
  
  54efc9cd
- Merge branch 'master' of github.com:EleutherAI/lm_evaluation_harness · 36c61674
  Leo Gao authored Jun 05, 2021
  
  36c61674
- Bump best_download version · b6776b82
  Leo Gao authored Jun 05, 2021
  
  b6776b82
05 Jun, 2021 5 commits
- Update python-app.yml · c9f81dc9
  Leo Gao authored Jun 04, 2021
  
  c9f81dc9
- convert all enabled tasks to use best_download for better download robustness · 20229183
  Leo Gao authored Jun 04, 2021
  
  20229183
- fix bug where interrupted pile download doesnt correctly resume · 85277915
  Leo Gao authored Jun 04, 2021
  
  85277915
- Add tests to make sure task definitions don't change without the version also changing · 17c825d1
  Leo Gao authored Jun 04, 2021
  
  17c825d1
- Add task versioning · 105fa974
  Leo Gao authored Jun 04, 2021
  
  105fa974
22 May, 2021 2 commits
- Merge branch 'master' of github.com:EleutherAI/lm_evaluation_harness · f76e6367
  Leo Gao authored May 21, 2021
  
  f76e6367
- make create_from_arg_string fully general · 9d6d291f
  Leo Gao authored May 21, 2021
```
for some reason putting it in LM and having it be inherited breaks
everything. should try to figure this out at some point.
```
  9d6d291f
21 May, 2021 1 commit
- Add missing () in fewshot-no-training-path · 031e6aca
  Leo Gao authored May 21, 2021
  
  031e6aca
16 May, 2021 1 commit
- Merge branch 'master' of github.com:EleutherAI/lm_evaluation_harness · 2bb67c98
  Leo Gao authored May 15, 2021
  
  2bb67c98