Commits · d0d86b1ca6b828c6f35be842443e6f9e61ba979e · gaoqiong / lm-evaluation-harness

08 Aug, 2023 4 commits
- add all crows pairs variants · d0d86b1c
  haileyschoelkopf authored Aug 08, 2023
  
  d0d86b1c
- add french dataset task · 0247833d
  haileyschoelkopf authored Aug 08, 2023
  
  0247833d
- cleanup yaml · 9f67a436
  haileyschoelkopf authored Aug 08, 2023
  
  9f67a436
- crows pairs english works · b39ff106
  haileyschoelkopf authored Aug 08, 2023
  
  b39ff106
02 Aug, 2023 1 commit
- added logiqa, logiqa2 and loqieval tasks; fixed tests for greedy_until · 8591f089
  baberabb authored Aug 02, 2023
  
  8591f089
01 Aug, 2023 8 commits
- Update README.md · aa848227
  Hailey Schoelkopf authored Aug 01, 2023
  
  aa848227
- Update README.md · 8ebc85e8
  Lintang Sutawika authored Aug 01, 2023
  
  8ebc85e8
- update on metrics and delet files · e37698df
  lintangsutawika authored Aug 01, 2023
  
  e37698df
- added rte · 1bc408ff
  lintangsutawika authored Aug 01, 2023
  
  1bc408ff
- fix configs · 223da391
  lintangsutawika authored Aug 01, 2023
  
  223da391
- remove comments · 8da6033f
  lintangsutawika authored Aug 01, 2023
  
  8da6033f
- fix Pile dataset name · 540d468e
  haileyschoelkopf authored Aug 01, 2023
  
  540d468e
- changed dataset_path · c8b434db
  baberabb authored Aug 01, 2023
  
  c8b434db
30 Jul, 2023 1 commit
- remove temperature · c79d71fd
  baberabb authored Jul 30, 2023
  
  c79d71fd
29 Jul, 2023 3 commits
- added regex · b0cbf5d7
  baberabb authored Jul 30, 2023
  
  b0cbf5d7
- add logieval · 19f6d1bd
  baberabb authored Jul 29, 2023
  
  19f6d1bd
- added logiqa2 and loading script · 66777b63
  baberabb authored Jul 29, 2023
  
  66777b63
24 Jul, 2023 1 commit
- removed promptsource yaml file · ed304c1d
  lintangsutawika authored Jul 24, 2023
  
  ed304c1d
21 Jul, 2023 1 commit
- [Refactor] Migrate xwinograd tasks to yaml · 94563a36
  Eddy Yeo authored Jul 21, 2023
  
  94563a36
20 Jul, 2023 1 commit
- changed nameing · 73c04968
  lintangsutawika authored Jul 20, 2023
  
  73c04968
19 Jul, 2023 1 commit
- can now process a benchmark that uses promptsource · 748a9898
  lintangsutawika authored Jul 19, 2023
  
  748a9898
18 Jul, 2023 2 commits
- [Refactor] Migrate webqs task to yaml · d2332149
  Eddy Yeo authored Jul 18, 2023
  
  d2332149
- remove template_aliases from existing tasks · 98c5411c
  haileyschoelkopf authored Jul 18, 2023
  
  98c5411c
17 Jul, 2023 6 commits
- attach group identifier to task for aggregation · 18a7c8b1
  lintangsutawika authored Jul 17, 2023
  
  18a7c8b1
- modified to arc_* · 1d995b6d
  lintangsutawika authored Jul 17, 2023
  
  1d995b6d
- Update anli_r3.yaml · 97a172ae
  Lintang Sutawika authored Jul 17, 2023
  
  97a172ae
- Update anli_r2.yaml · cd7f642d
  Lintang Sutawika authored Jul 17, 2023
  
  cd7f642d
- Update anli_r1.yaml · a7c1a639
  Lintang Sutawika authored Jul 17, 2023
  
  a7c1a639
- [Refactor] Migrate anli tasks to yaml · b783c68e
  Eddy Yeo authored Jul 17, 2023
  
  b783c68e
14 Jul, 2023 11 commits
- changes · e5161a6d
  lintangsutawika authored Jul 14, 2023
  
  e5161a6d
- add winogrande · 34fc9e68
  lintangsutawika authored Jul 05, 2023
  
  34fc9e68
- added include_benchmarks · 89c4ee5c
  lintangsutawika authored Jul 04, 2023
  
  89c4ee5c
- added benchmark configs · 1d3a1601
  lintangsutawika authored Jul 04, 2023
  
  1d3a1601
- change variable name · 15c186b7
  lintangsutawika authored Jul 04, 2023
  
  15c186b7
- added script to build benchmarks from promptsouce · e5306ea6
  lintangsutawika authored Jul 03, 2023
  
  e5306ea6
- update on how yaml file is made · 3713ec52
  lintangsutawika authored Jun 27, 2023
  
  3713ec52
- more tasks · ee098a47
  lintangsutawika authored Jun 21, 2023
  
  ee098a47
- changed name of boolq and cb config task · 7e565f33
  lintangsutawika authored Jun 21, 2023
  
  7e565f33
- override target_delimiter · a36348fa
  lintangsutawika authored Jul 14, 2023
  
  a36348fa
- fixed whitespace for target · addada53
  lintangsutawika authored Jul 14, 2023
  
  addada53