Commits · 29f12dd9e7923e3be3eada61d035e1a6799a2c12 · gaoqiong / lm-evaluation-harness

01 Aug, 2023 7 commits
- Update README.md · aa848227
  Hailey Schoelkopf authored Aug 01, 2023
  
  aa848227
- Update README.md · 8ebc85e8
  Lintang Sutawika authored Aug 01, 2023
  
  8ebc85e8
- update on metrics and delet files · e37698df
  lintangsutawika authored Aug 01, 2023
  
  e37698df
- added rte · 1bc408ff
  lintangsutawika authored Aug 01, 2023
  
  1bc408ff
- fix configs · 223da391
  lintangsutawika authored Aug 01, 2023
  
  223da391
- remove comments · 8da6033f
  lintangsutawika authored Aug 01, 2023
  
  8da6033f
- fix Pile dataset name · 540d468e
  haileyschoelkopf authored Aug 01, 2023
  
  540d468e
24 Jul, 2023 1 commit
- removed promptsource yaml file · ed304c1d
  lintangsutawika authored Jul 24, 2023
  
  ed304c1d
21 Jul, 2023 1 commit
- [Refactor] Migrate xwinograd tasks to yaml · 94563a36
  Eddy Yeo authored Jul 21, 2023
  
  94563a36
20 Jul, 2023 1 commit
- changed nameing · 73c04968
  lintangsutawika authored Jul 20, 2023
  
  73c04968
19 Jul, 2023 1 commit
- can now process a benchmark that uses promptsource · 748a9898
  lintangsutawika authored Jul 19, 2023
  
  748a9898
18 Jul, 2023 2 commits
- [Refactor] Migrate webqs task to yaml · d2332149
  Eddy Yeo authored Jul 18, 2023
  
  d2332149
- remove template_aliases from existing tasks · 98c5411c
  haileyschoelkopf authored Jul 18, 2023
  
  98c5411c
17 Jul, 2023 6 commits
- attach group identifier to task for aggregation · 18a7c8b1
  lintangsutawika authored Jul 17, 2023
  
  18a7c8b1
- modified to arc_* · 1d995b6d
  lintangsutawika authored Jul 17, 2023
  
  1d995b6d
- Update anli_r3.yaml · 97a172ae
  Lintang Sutawika authored Jul 17, 2023
  
  97a172ae
- Update anli_r2.yaml · cd7f642d
  Lintang Sutawika authored Jul 17, 2023
  
  cd7f642d
- Update anli_r1.yaml · a7c1a639
  Lintang Sutawika authored Jul 17, 2023
  
  a7c1a639
- [Refactor] Migrate anli tasks to yaml · b783c68e
  Eddy Yeo authored Jul 17, 2023
  
  b783c68e
14 Jul, 2023 17 commits
- changes · e5161a6d
  lintangsutawika authored Jul 14, 2023
  
  e5161a6d
- add winogrande · 34fc9e68
  lintangsutawika authored Jul 05, 2023
  
  34fc9e68
- added include_benchmarks · 89c4ee5c
  lintangsutawika authored Jul 04, 2023
  
  89c4ee5c
- added benchmark configs · 1d3a1601
  lintangsutawika authored Jul 04, 2023
  
  1d3a1601
- change variable name · 15c186b7
  lintangsutawika authored Jul 04, 2023
  
  15c186b7
- added script to build benchmarks from promptsouce · e5306ea6
  lintangsutawika authored Jul 03, 2023
  
  e5306ea6
- update on how yaml file is made · 3713ec52
  lintangsutawika authored Jun 27, 2023
  
  3713ec52
- more tasks · ee098a47
  lintangsutawika authored Jun 21, 2023
  
  ee098a47
- changed name of boolq and cb config task · 7e565f33
  lintangsutawika authored Jun 21, 2023
  
  7e565f33
- override target_delimiter · a36348fa
  lintangsutawika authored Jul 14, 2023
  
  a36348fa
- fixed whitespace for target · addada53
  lintangsutawika authored Jul 14, 2023
  
  addada53
- adjustments for super_glue · b0597a94
  lintangsutawika authored Jul 14, 2023
  
  b0597a94
- formatted · f7dde0c3
  lintangsutawika authored Jul 14, 2023
  
  f7dde0c3
- updates, corrections, and fixes to match big-refactor · ee633332
  lintangsutawika authored Jul 14, 2023
  
  ee633332
- config fixes · 248b45da
  lintangsutawika authored Jul 14, 2023
  
  248b45da
- fixes to boolq · f4efb8e5
  lintangsutawika authored Jul 14, 2023
  
  f4efb8e5
- fixes to bollq · ae41f67c
  lintangsutawika authored Jul 14, 2023
  
  ae41f67c
13 Jul, 2023 4 commits
- Update README.md · 98c85d73
  Hailey Schoelkopf authored Jul 13, 2023
  
  98c85d73
- doc_to_choice can run when a promptsource template is defined · ce5ec854
  lintangsutawika authored Jul 13, 2023
  
  ce5ec854
- adjust wsc · 5288813a
  lintangsutawika authored Jul 13, 2023
  
  5288813a
- fixed doc_to_choice in race · e9432fad
  lintangsutawika authored Jul 13, 2023
  
  e9432fad