Commits · 00038fea6711e14a74882db05b7fb8b711c48104 · gaoqiong / lm-evaluation-harness

"test/config/tuners/search_space_advisor.json" did not exist on "a38725050d463406b00ba0f1af3b334182c4d20e"

05 Oct, 2020 7 commits
- Q/A instead of Question/Answer · 00038fea
  Leo Gao authored Oct 05, 2020
  
  00038fea
- write_out: fallover to training data if no validation · 6c816cb7
  Leo Gao authored Oct 05, 2020
  
  6c816cb7
- Add WebQs (data only) · 31b2a5dd
  Leo Gao authored Oct 05, 2020
  
  31b2a5dd
- Fix include_target · 6cc21f4b
  Leo Gao authored Oct 05, 2020
  
  6cc21f4b
- Implement ARC (data) · 12852d5c
  Leo Gao authored Oct 05, 2020
  
  12852d5c
- Implement ARC · 9e29c2a8
  Leo Gao authored Oct 04, 2020
  
  9e29c2a8
- Rename NLP_TASK · edbb1a49
  Leo Gao authored Oct 04, 2020
  
  edbb1a49
04 Oct, 2020 4 commits
- Merge branch 'master' of https://github.com/EleutherAI/lm_evaluation_harness · d53969b5
  Anish Thite authored Oct 04, 2020
  
  d53969b5
- add drop data + doc2text · ec4d3615
  Anish Thite authored Oct 04, 2020
  
  ec4d3615
- Remove residual MODEL_REGISTRY · d9e50f87
  Leo Gao authored Oct 03, 2020
  
  d9e50f87
- Fix GPT2 impl partially · ffea4dc5
  Leo Gao authored Oct 03, 2020
```
TODO: still need to add `until` everywhere
```
  ffea4dc5
18 Sep, 2020 1 commit
- Merge pull request #33 from zphang/retrieval · 5888a695
  Leo Gao authored Sep 17, 2020
```
Refactor for explicit imports
```
  5888a695
17 Sep, 2020 2 commits
- refactor to explicit registries · 515d78b3
  Jason Phang authored Sep 17, 2020
  
  515d78b3
- refactor to explicit registries · 89de8d7d
  Jason Phang authored Sep 17, 2020
  
  89de8d7d
16 Sep, 2020 1 commit
- Merge pull request #4 from zphang/superglue_part_1 · 635a2155
  Stella Biderman authored Sep 16, 2020
```
SuperGLUE part 1
```
  635a2155
14 Sep, 2020 3 commits
- Update docs · f1ec7b06
  Jason Phang authored Sep 14, 2020
  
  f1ec7b06
- cleanup · a85ad214
  Jason Phang authored Sep 14, 2020
  
  a85ad214
- SuperGLUE, and truncation · 8161c22e
  Jason Phang authored Sep 14, 2020
  
  8161c22e
09 Sep, 2020 1 commit
- Merge pull request #3 from zphang/refactor · ffbaef21
  Stella Biderman authored Sep 09, 2020
```
LM Eval Refactor; GPT-3; GLUE tasks
```
  ffbaef21
07 Sep, 2020 18 commits
- GPT-2 fixes · e7a87e71
  Jason Phang authored Sep 07, 2020
  
  e7a87e71
- seed · 9987203f
  Jason Phang authored Sep 07, 2020
  
  9987203f
- remove seeding · 32624a1d
  Jason Phang authored Sep 07, 2020
  
  32624a1d
- lib · f88bb827
  Jason Phang authored Sep 07, 2020
  
  f88bb827
- glue tasks · cf80f340
  Jason Phang authored Sep 07, 2020
  
  cf80f340
- combine gpt2 · c2aaa501
  Jason Phang authored Sep 07, 2020
  
  c2aaa501
- checkin · 2d4b3a8c
  Jason Phang authored Sep 07, 2020
  
  2d4b3a8c
- gpt3 · 12e12bc0
  Jason Phang authored Sep 07, 2020
  
  12e12bc0
- Merge branch 'master' of git@github.com:EleutherAI/lm_evaluation_harness.git · 7a32afeb
  Leo Gao authored Sep 06, 2020
  
  7a32afeb
- Update boolq · 1f3b3988
  Leo Gao authored Sep 06, 2020
  
  1f3b3988
- GPT2: add device parameter · ba2b849c
  Leo Gao authored Sep 06, 2020
  
  ba2b849c
- Implement boolq dataset · 5bb5e96d
  Leo Gao authored Sep 06, 2020
  
  5bb5e96d
- Implement gpt2 loglikelihood · 8fffd927
  Leo Gao authored Sep 06, 2020
  
  8fffd927
- Add extra options to evaluate · 31696910
  Leo Gao authored Sep 06, 2020
  
  31696910
- Change nll to loglikelihood · 75920267
  Leo Gao authored Sep 06, 2020
  
  75920267
- add generate docs and generate text for coqa · a2871d9c
  Anish Thite authored Sep 06, 2020
  
  a2871d9c
- add gitignore for data/ · 345f5fef
  Anish Thite authored Sep 06, 2020
  
  345f5fef
- merge changes, added datasets to README.md and if train dataset or val dataset exists · bd348542
  Anish Thite authored Sep 06, 2020
  
  bd348542
06 Sep, 2020 3 commits
- Add evaluate method · 8a5a5f74
  Leo Gao authored Sep 06, 2020
  
  8a5a5f74
- Merge pull request #2 from zphang/readme_update · 472a67d3
  Anish Thite authored Sep 06, 2020
```
Update README
```
  472a67d3
- Update README · 185c6ade
  Jason Phang authored Sep 06, 2020
  
  185c6ade