Commits · 3de2c0e7e73d5ea1e18327f4ab76cdd93675e14b · gaoqiong / lm-evaluation-harness

14 Aug, 2023 1 commit
- adjustments to have `task` to modify a task name in benchmark · 3de2c0e7
  lintangsutawika authored Aug 14, 2023
  
  3de2c0e7
13 Aug, 2023 3 commits
- formate · ce8c2b14
  lintangsutawika authored Aug 13, 2023
  
  ce8c2b14
- update and fixes · 5ddabc29
  lintangsutawika authored Aug 13, 2023
  
  5ddabc29
- moved to a new dir · f4813cfc
  lintangsutawika authored Aug 13, 2023
  
  f4813cfc
10 Aug, 2023 4 commits
- Patch Blimp · 506a32ac
  Lintang Sutawika authored Aug 10, 2023
  
  506a32ac
- Update README.md · f0cc1507
  Lintang Sutawika authored Aug 10, 2023
  
  f0cc1507
- format · b22ccf92
  lintangsutawika authored Aug 10, 2023
  
  b22ccf92
- add blimp · b20bb95f
  lintangsutawika authored Aug 10, 2023
  
  b20bb95f
09 Aug, 2023 3 commits
- checklist README.md · 53487cf6
  lintangsutawika authored Aug 09, 2023
  
  53487cf6
- doc_to_target set to just label · ce1389c9
  lintangsutawika authored Aug 09, 2023
  
  ce1389c9
- pre-commit format · dd8bbe2c
  lintangsutawika authored Aug 09, 2023
  
  dd8bbe2c
08 Aug, 2023 11 commits
- add babi task · 87323176
  haileyschoelkopf authored Aug 08, 2023
  
  87323176
- add documentation on tasks · 3c8610c5
  haileyschoelkopf authored Aug 08, 2023
  
  3c8610c5
- add all crows pairs variants · d0d86b1c
  haileyschoelkopf authored Aug 08, 2023
  
  d0d86b1c
- add french dataset task · 0247833d
  haileyschoelkopf authored Aug 08, 2023
  
  0247833d
- cleanup yaml · 9f67a436
  haileyschoelkopf authored Aug 08, 2023
  
  9f67a436
- crows pairs english works · b39ff106
  haileyschoelkopf authored Aug 08, 2023
  
  b39ff106
- add xcopa · 1a2cf3b2
  lintangsutawika authored Aug 08, 2023
  
  1a2cf3b2
- Update README.md · 7f69c48b
  Lintang Sutawika authored Aug 08, 2023
  
  7f69c48b
- Update README.md · e4ceb227
  Hailey Schoelkopf authored Aug 08, 2023
  
  e4ceb227
- Update README.md · 07bd8c03
  Hailey Schoelkopf authored Aug 08, 2023
  
  07bd8c03
- Update README.md · a9de5550
  Hailey Schoelkopf authored Aug 08, 2023
  
  a9de5550
02 Aug, 2023 1 commit
- added logiqa, logiqa2 and loqieval tasks; fixed tests for greedy_until · 8591f089
  baberabb authored Aug 02, 2023
  
  8591f089
01 Aug, 2023 8 commits
- Update README.md · aa848227
  Hailey Schoelkopf authored Aug 01, 2023
  
  aa848227
- Update README.md · 8ebc85e8
  Lintang Sutawika authored Aug 01, 2023
  
  8ebc85e8
- update on metrics and delet files · e37698df
  lintangsutawika authored Aug 01, 2023
  
  e37698df
- added rte · 1bc408ff
  lintangsutawika authored Aug 01, 2023
  
  1bc408ff
- fix configs · 223da391
  lintangsutawika authored Aug 01, 2023
  
  223da391
- remove comments · 8da6033f
  lintangsutawika authored Aug 01, 2023
  
  8da6033f
- fix Pile dataset name · 540d468e
  haileyschoelkopf authored Aug 01, 2023
  
  540d468e
- changed dataset_path · c8b434db
  baberabb authored Aug 01, 2023
  
  c8b434db
30 Jul, 2023 1 commit
- remove temperature · c79d71fd
  baberabb authored Jul 30, 2023
  
  c79d71fd
29 Jul, 2023 3 commits
- added regex · b0cbf5d7
  baberabb authored Jul 30, 2023
  
  b0cbf5d7
- add logieval · 19f6d1bd
  baberabb authored Jul 29, 2023
  
  19f6d1bd
- added logiqa2 and loading script · 66777b63
  baberabb authored Jul 29, 2023
  
  66777b63
24 Jul, 2023 1 commit
- removed promptsource yaml file · ed304c1d
  lintangsutawika authored Jul 24, 2023
  
  ed304c1d
21 Jul, 2023 1 commit
- [Refactor] Migrate xwinograd tasks to yaml · 94563a36
  Eddy Yeo authored Jul 21, 2023
  
  94563a36
20 Jul, 2023 1 commit
- changed nameing · 73c04968
  lintangsutawika authored Jul 20, 2023
  
  73c04968
19 Jul, 2023 1 commit
- can now process a benchmark that uses promptsource · 748a9898
  lintangsutawika authored Jul 19, 2023
  
  748a9898
18 Jul, 2023 1 commit
- [Refactor] Migrate webqs task to yaml · d2332149
  Eddy Yeo authored Jul 18, 2023
  
  d2332149