Commits · 80f5fc3be7717e38bcbd3e39e725c32afd96086e · gaoqiong / lm-evaluation-harness

22 Oct, 2020 7 commits
- Added QuAC dataset. · 40cc4e28
  Charles Foster authored Oct 22, 2020
  
  40cc4e28
- Clarified that SQuaD does not include a test set. · 76b08133
  Charles Foster authored Oct 21, 2020
  
  76b08133
- Added SQuAD v2 dataset · 5c58b267
  Charles Foster authored Oct 21, 2020
  
  5c58b267
- Updated RACE to use datasets instead of nlp package. · b106e4f7
  Charles Foster authored Oct 21, 2020
  
  b106e4f7
- Add HellaSwag dataset. · a245d2e4
  Charles Foster authored Oct 21, 2020
  
  a245d2e4
- Added openbookqa to registry. · 8402847e
  Charles Foster authored Oct 21, 2020
  
  8402847e
- Added openbookqa · 4c8ec8af
  Charles Foster authored Oct 21, 2020
  
  4c8ec8af
13 Oct, 2020 1 commit
- Update COPA cause/effect · d5893cdc
  Jason Phang authored Oct 13, 2020
  
  d5893cdc
06 Oct, 2020 2 commits
- Add ANLI · aa125d0a
  Leo Gao authored Oct 05, 2020
  
  aa125d0a
- Add abstract constructor · 988a400f
  Leo Gao authored Oct 05, 2020
  
  988a400f
05 Oct, 2020 17 commits
- Don't make Dataset.download abstract · b0585de4
  Leo Gao authored Oct 05, 2020
```
It's ok if subclasses don't implement download, no-op default is ok
```
  b0585de4
- More search and replace · a5c48976
  Leo Gao authored Oct 05, 2020
  
  a5c48976
- Replace HFNLPTask with HFTask everywhere · 6469a0e7
  Leo Gao authored Oct 05, 2020
  
  6469a0e7
- change HF_Dataset to HFTask · 5a6c172e
  sdtblck authored Oct 05, 2020
  
  5a6c172e
- add lambada · 08f2ed6e
  sdtblck authored Oct 05, 2020
  
  08f2ed6e
- add lambada · fb8c3df9
  sdtblck authored Oct 05, 2020
  
  fb8c3df9
- name changes · b0e715ee
  sdtblck authored Oct 05, 2020
  
  b0e715ee
- add download method to base class · 4e2d1498
  sdtblck authored Oct 05, 2020
  
  4e2d1498
- add download method to base class · ff2d2ada
  sdtblck authored Oct 05, 2020
  
  ff2d2ada
- update nlp class to use HF datasets library · 53d4f850
  sdtblck authored Oct 05, 2020
  
  53d4f850
- multirc · bac0a528
  Jason Phang authored Oct 05, 2020
  
  bac0a528
- Q/A instead of Question/Answer · 00038fea
  Leo Gao authored Oct 05, 2020
  
  00038fea
- Add WebQs (data only) · 31b2a5dd
  Leo Gao authored Oct 05, 2020
  
  31b2a5dd
- Fix include_target · 6cc21f4b
  Leo Gao authored Oct 05, 2020
  
  6cc21f4b
- Implement ARC (data) · 12852d5c
  Leo Gao authored Oct 05, 2020
  
  12852d5c
- Implement ARC · 9e29c2a8
  Leo Gao authored Oct 04, 2020
  
  9e29c2a8
- Rename NLP_TASK · edbb1a49
  Leo Gao authored Oct 04, 2020
  
  edbb1a49
04 Oct, 2020 3 commits
- add drop data + doc2text · ec4d3615
  Anish Thite authored Oct 04, 2020
  
  ec4d3615
- Remove residual MODEL_REGISTRY · d9e50f87
  Leo Gao authored Oct 03, 2020
  
  d9e50f87
- Fix GPT2 impl partially · ffea4dc5
  Leo Gao authored Oct 03, 2020
```
TODO: still need to add `until` everywhere
```
  ffea4dc5
17 Sep, 2020 2 commits
- refactor to explicit registries · 515d78b3
  Jason Phang authored Sep 17, 2020
  
  515d78b3
- refactor to explicit registries · 89de8d7d
  Jason Phang authored Sep 17, 2020
  
  89de8d7d
14 Sep, 2020 3 commits
- Update docs · f1ec7b06
  Jason Phang authored Sep 14, 2020
  
  f1ec7b06
- cleanup · a85ad214
  Jason Phang authored Sep 14, 2020
  
  a85ad214
- SuperGLUE, and truncation · 8161c22e
  Jason Phang authored Sep 14, 2020
  
  8161c22e
07 Sep, 2020 4 commits
- GPT-2 fixes · e7a87e71
  Jason Phang authored Sep 07, 2020
  
  e7a87e71
- seed · 9987203f
  Jason Phang authored Sep 07, 2020
  
  9987203f
- remove seeding · 32624a1d
  Jason Phang authored Sep 07, 2020
  
  32624a1d
- lib · f88bb827
  Jason Phang authored Sep 07, 2020
  
  f88bb827