Commits · dc3560d03f8535710777bc0446540847f30750d1 · gaoqiong / lm-evaluation-harness

"llama/patches/0006-fix-deepseek-deseret-regex.patch" did not exist on "527cc9789995bf3125bc310bfff19eecbfd6c9a0"

24 Oct, 2020 5 commits
- Updates to natural questions answer handling. Now uses long answers alwasy. · dc3560d0
  Charles Foster authored Oct 24, 2020
  
  dc3560d0
- Small typos · d51f3e7f
  Charles Foster authored Oct 24, 2020
  
  d51f3e7f
- Updates to natural questions to deal with memory issues. · 9291edaa
  Charles Foster authored Oct 24, 2020
  
  9291edaa
- Removed apache_beam dependency. · 0dda9f63
  Charles Foster authored Oct 24, 2020
  
  0dda9f63
- Added natural questions. Not yet validated or tested with a call to write. · 9426db16
  Charles Foster authored Oct 23, 2020
  
  9426db16
22 Oct, 2020 8 commits
- Added QuAC dataset. · 40cc4e28
  Charles Foster authored Oct 22, 2020
  
  40cc4e28
- Clarified that SQuaD does not include a test set. · 76b08133
  Charles Foster authored Oct 21, 2020
  
  76b08133
- Added SQuAD v2 dataset · 5c58b267
  Charles Foster authored Oct 21, 2020
  
  5c58b267
- Updated RACE to use datasets instead of nlp package. · b106e4f7
  Charles Foster authored Oct 21, 2020
  
  b106e4f7
- Add Winogrande dataset. · dbe43ec3
  Charles Foster authored Oct 21, 2020
  
  dbe43ec3
- Add HellaSwag dataset. · a245d2e4
  Charles Foster authored Oct 21, 2020
  
  a245d2e4
- Added openbookqa to registry. · 8402847e
  Charles Foster authored Oct 21, 2020
  
  8402847e
- Added openbookqa · 4c8ec8af
  Charles Foster authored Oct 21, 2020
  
  4c8ec8af
13 Oct, 2020 1 commit
- Update COPA cause/effect · d5893cdc
  Jason Phang authored Oct 13, 2020
  
  d5893cdc
06 Oct, 2020 1 commit
- Add ANLI · aa125d0a
  Leo Gao authored Oct 05, 2020
  
  aa125d0a
05 Oct, 2020 15 commits
- More search and replace · a5c48976
  Leo Gao authored Oct 05, 2020
  
  a5c48976
- Replace HFNLPTask with HFTask everywhere · 6469a0e7
  Leo Gao authored Oct 05, 2020
  
  6469a0e7
- change HF_Dataset to HFTask · 5a6c172e
  sdtblck authored Oct 05, 2020
  
  5a6c172e
- add lambada · 08f2ed6e
  sdtblck authored Oct 05, 2020
  
  08f2ed6e
- add lambada · fb8c3df9
  sdtblck authored Oct 05, 2020
  
  fb8c3df9
- name changes · b0e715ee
  sdtblck authored Oct 05, 2020
  
  b0e715ee
- add download method to base class · ff2d2ada
  sdtblck authored Oct 05, 2020
  
  ff2d2ada
- update nlp class to use HF datasets library · 53d4f850
  sdtblck authored Oct 05, 2020
  
  53d4f850
- multirc · bac0a528
  Jason Phang authored Oct 05, 2020
  
  bac0a528
- Q/A instead of Question/Answer · 00038fea
  Leo Gao authored Oct 05, 2020
  
  00038fea
- Add WebQs (data only) · 31b2a5dd
  Leo Gao authored Oct 05, 2020
  
  31b2a5dd
- Fix include_target · 6cc21f4b
  Leo Gao authored Oct 05, 2020
  
  6cc21f4b
- Implement ARC (data) · 12852d5c
  Leo Gao authored Oct 05, 2020
  
  12852d5c
- Implement ARC · 9e29c2a8
  Leo Gao authored Oct 04, 2020
  
  9e29c2a8
- Rename NLP_TASK · edbb1a49
  Leo Gao authored Oct 04, 2020
  
  edbb1a49
04 Oct, 2020 1 commit
- add drop data + doc2text · ec4d3615
  Anish Thite authored Oct 04, 2020
  
  ec4d3615
17 Sep, 2020 2 commits
- refactor to explicit registries · 515d78b3
  Jason Phang authored Sep 17, 2020
  
  515d78b3
- refactor to explicit registries · 89de8d7d
  Jason Phang authored Sep 17, 2020
  
  89de8d7d
14 Sep, 2020 2 commits
- cleanup · a85ad214
  Jason Phang authored Sep 14, 2020
  
  a85ad214
- SuperGLUE, and truncation · 8161c22e
  Jason Phang authored Sep 14, 2020
  
  8161c22e
07 Sep, 2020 3 commits
- seed · 9987203f
  Jason Phang authored Sep 07, 2020
  
  9987203f
- remove seeding · 32624a1d
  Jason Phang authored Sep 07, 2020
  
  32624a1d
- lib · f88bb827
  Jason Phang authored Sep 07, 2020
  
  f88bb827