Commits · c9f3b113febbf743b3603029d63530d214e20730 · gaoqiong / lm-evaluation-harness

"lm_eval/tasks/zhoblimp/_template_yaml" did not exist on "c3c05b067d28ecd238d6cffef32ddcbfd085a99d"

24 Oct, 2020 11 commits
- add no target for storycloze · c9f3b113
  Anish Thite authored Oct 24, 2020
  
  c9f3b113
- add include target for coqa · e3c2e692
  Anish Thite authored Oct 24, 2020
  
  e3c2e692
- add piqa text · 7c55e46b
  Anish Thite authored Oct 24, 2020
  
  7c55e46b
- add storycloze · 042e2926
  Anish Thite authored Oct 24, 2020
  
  042e2926
- update triviaqa download · 0f2b9317
  Anish Thite authored Oct 24, 2020
  
  0f2b9317
- add triviaqa data · 8bfaaa50
  Anish Thite authored Oct 24, 2020
  
  8bfaaa50
- update coqa dev set · 97e5a566
  Anish Thite authored Oct 24, 2020
  
  97e5a566
- update coqa dev set · db3fe0d6
  Anish Thite authored Oct 24, 2020
  
  db3fe0d6
- update coqa to be consistent with gpt3 paper · 5d601e14
  Anish Thite authored Oct 24, 2020
  
  5d601e14
- make drop text consistent with gpt3 paper · 43fc77a2
  Anish Thite authored Oct 24, 2020
  
  43fc77a2
- add Wikitext2 + wikitext103 data · 262fe250
  Anish Thite authored Oct 23, 2020
  
  262fe250
23 Oct, 2020 1 commit

Renamed WSC to make distinction between SuperGLUE Winograd Schemas... · 05bd05e9

Charles Foster authored Oct 23, 2020

Renamed WSC to make distinction between SuperGLUE Winograd Schemas (SGWinogradSchemaChallenge) and WSC273 (WinogradSchemaChallenge273) clearer. Also, added WSC273.

05bd05e9

22 Oct, 2020 8 commits
- Added QuAC dataset. · 40cc4e28
  Charles Foster authored Oct 22, 2020
  
  40cc4e28
- Clarified that SQuaD does not include a test set. · 76b08133
  Charles Foster authored Oct 21, 2020
  
  76b08133
- Added SQuAD v2 dataset · 5c58b267
  Charles Foster authored Oct 21, 2020
  
  5c58b267
- Updated RACE to use datasets instead of nlp package. · b106e4f7
  Charles Foster authored Oct 21, 2020
  
  b106e4f7
- Add Winogrande dataset. · dbe43ec3
  Charles Foster authored Oct 21, 2020
  
  dbe43ec3
- Add HellaSwag dataset. · a245d2e4
  Charles Foster authored Oct 21, 2020
  
  a245d2e4
- Added openbookqa to registry. · 8402847e
  Charles Foster authored Oct 21, 2020
  
  8402847e
- Added openbookqa · 4c8ec8af
  Charles Foster authored Oct 21, 2020
  
  4c8ec8af
13 Oct, 2020 1 commit
- Update COPA cause/effect · d5893cdc
  Jason Phang authored Oct 13, 2020
  
  d5893cdc
06 Oct, 2020 1 commit
- Add ANLI · aa125d0a
  Leo Gao authored Oct 05, 2020
  
  aa125d0a
05 Oct, 2020 15 commits
- More search and replace · a5c48976
  Leo Gao authored Oct 05, 2020
  
  a5c48976
- Replace HFNLPTask with HFTask everywhere · 6469a0e7
  Leo Gao authored Oct 05, 2020
  
  6469a0e7
- change HF_Dataset to HFTask · 5a6c172e
  sdtblck authored Oct 05, 2020
  
  5a6c172e
- add lambada · 08f2ed6e
  sdtblck authored Oct 05, 2020
  
  08f2ed6e
- add lambada · fb8c3df9
  sdtblck authored Oct 05, 2020
  
  fb8c3df9
- name changes · b0e715ee
  sdtblck authored Oct 05, 2020
  
  b0e715ee
- add download method to base class · ff2d2ada
  sdtblck authored Oct 05, 2020
  
  ff2d2ada
- update nlp class to use HF datasets library · 53d4f850
  sdtblck authored Oct 05, 2020
  
  53d4f850
- multirc · bac0a528
  Jason Phang authored Oct 05, 2020
  
  bac0a528
- Q/A instead of Question/Answer · 00038fea
  Leo Gao authored Oct 05, 2020
  
  00038fea
- Add WebQs (data only) · 31b2a5dd
  Leo Gao authored Oct 05, 2020
  
  31b2a5dd
- Fix include_target · 6cc21f4b
  Leo Gao authored Oct 05, 2020
  
  6cc21f4b
- Implement ARC (data) · 12852d5c
  Leo Gao authored Oct 05, 2020
  
  12852d5c
- Implement ARC · 9e29c2a8
  Leo Gao authored Oct 04, 2020
  
  9e29c2a8
- Rename NLP_TASK · edbb1a49
  Leo Gao authored Oct 04, 2020
  
  edbb1a49
04 Oct, 2020 1 commit
- add drop data + doc2text · ec4d3615
  Anish Thite authored Oct 04, 2020
  
  ec4d3615
17 Sep, 2020 2 commits
- refactor to explicit registries · 515d78b3
  Jason Phang authored Sep 17, 2020
  
  515d78b3
- refactor to explicit registries · 89de8d7d
  Jason Phang authored Sep 17, 2020
  
  89de8d7d