Commits · 988a400f61901265e0625bcb8fe10cb7c3bd93e4 · gaoqiong / lm-evaluation-harness

06 Oct, 2020 1 commit
- Add abstract constructor · 988a400f
  Leo Gao authored Oct 05, 2020
  
  988a400f
05 Oct, 2020 22 commits
- Don't make Dataset.download abstract · b0585de4
  Leo Gao authored Oct 05, 2020
```
It's ok if subclasses don't implement download, no-op default is ok
```
  b0585de4
- More search and replace · a5c48976
  Leo Gao authored Oct 05, 2020
  
  a5c48976
- Replace HFNLPTask with HFTask everywhere · 6469a0e7
  Leo Gao authored Oct 05, 2020
  
  6469a0e7
- Merge pull request #39 from EleutherAI/add_lambada · f348fa2c
  Leo Gao authored Oct 05, 2020
```
add_lambada
```
  f348fa2c
- Merge branch 'master' into add_lambada · f161731c
  sdtblck authored Oct 05, 2020
  
  f161731c
- change HF_Dataset to HFTask · 5a6c172e
  sdtblck authored Oct 05, 2020
  
  5a6c172e
- add lambada · 08f2ed6e
  sdtblck authored Oct 05, 2020
  
  08f2ed6e
- add lambada · fb8c3df9
  sdtblck authored Oct 05, 2020
  
  fb8c3df9
- name changes · b0e715ee
  sdtblck authored Oct 05, 2020
  
  b0e715ee
- Merge pull request #37 from EleutherAI/download_on_demand · 43978e3b
  Anish Thite authored Oct 05, 2020
```
download_on_demand
```
  43978e3b
- add download method to base class · 4e2d1498
  sdtblck authored Oct 05, 2020
  
  4e2d1498
- add download method to base class · ff2d2ada
  sdtblck authored Oct 05, 2020
  
  ff2d2ada
- update nlp class to use HF datasets library · 53d4f850
  sdtblck authored Oct 05, 2020
  
  53d4f850
- Merge pull request #35 from zphang/superglue2 · d6b91191
  Stella Biderman authored Oct 05, 2020
```
MultiRC
```
  d6b91191
- multirc · bac0a528
  Jason Phang authored Oct 05, 2020
  
  bac0a528
- Q/A instead of Question/Answer · 00038fea
  Leo Gao authored Oct 05, 2020
  
  00038fea
- write_out: fallover to training data if no validation · 6c816cb7
  Leo Gao authored Oct 05, 2020
  
  6c816cb7
- Add WebQs (data only) · 31b2a5dd
  Leo Gao authored Oct 05, 2020
  
  31b2a5dd
- Fix include_target · 6cc21f4b
  Leo Gao authored Oct 05, 2020
  
  6cc21f4b
- Implement ARC (data) · 12852d5c
  Leo Gao authored Oct 05, 2020
  
  12852d5c
- Implement ARC · 9e29c2a8
  Leo Gao authored Oct 04, 2020
  
  9e29c2a8
- Rename NLP_TASK · edbb1a49
  Leo Gao authored Oct 04, 2020
  
  edbb1a49
04 Oct, 2020 4 commits
- Merge branch 'master' of https://github.com/EleutherAI/lm_evaluation_harness · d53969b5
  Anish Thite authored Oct 04, 2020
  
  d53969b5
- add drop data + doc2text · ec4d3615
  Anish Thite authored Oct 04, 2020
  
  ec4d3615
- Remove residual MODEL_REGISTRY · d9e50f87
  Leo Gao authored Oct 03, 2020
  
  d9e50f87
- Fix GPT2 impl partially · ffea4dc5
  Leo Gao authored Oct 03, 2020
```
TODO: still need to add `until` everywhere
```
  ffea4dc5
18 Sep, 2020 1 commit
- Merge pull request #33 from zphang/retrieval · 5888a695
  Leo Gao authored Sep 17, 2020
```
Refactor for explicit imports
```
  5888a695
17 Sep, 2020 2 commits
- refactor to explicit registries · 515d78b3
  Jason Phang authored Sep 17, 2020
  
  515d78b3
- refactor to explicit registries · 89de8d7d
  Jason Phang authored Sep 17, 2020
  
  89de8d7d
16 Sep, 2020 1 commit
- Merge pull request #4 from zphang/superglue_part_1 · 635a2155
  Stella Biderman authored Sep 16, 2020
```
SuperGLUE part 1
```
  635a2155
14 Sep, 2020 3 commits
- Update docs · f1ec7b06
  Jason Phang authored Sep 14, 2020
  
  f1ec7b06
- cleanup · a85ad214
  Jason Phang authored Sep 14, 2020
  
  a85ad214
- SuperGLUE, and truncation · 8161c22e
  Jason Phang authored Sep 14, 2020
  
  8161c22e
09 Sep, 2020 1 commit
- Merge pull request #3 from zphang/refactor · ffbaef21
  Stella Biderman authored Sep 09, 2020
```
LM Eval Refactor; GPT-3; GLUE tasks
```
  ffbaef21
07 Sep, 2020 5 commits
- GPT-2 fixes · e7a87e71
  Jason Phang authored Sep 07, 2020
  
  e7a87e71
- seed · 9987203f
  Jason Phang authored Sep 07, 2020
  
  9987203f
- remove seeding · 32624a1d
  Jason Phang authored Sep 07, 2020
  
  32624a1d
- lib · f88bb827
  Jason Phang authored Sep 07, 2020
  
  f88bb827
- glue tasks · cf80f340
  Jason Phang authored Sep 07, 2020
  
  cf80f340