Commits · 748a98989de4e61cbfd56eaed84920f33e8ce80e · gaoqiong / lm-evaluation-harness

19 Jul, 2023 1 commit
- can now process a benchmark that uses promptsource · 748a9898
  lintangsutawika authored Jul 19, 2023
  
  748a9898
17 Jul, 2023 6 commits
- attach group identifier to task for aggregation · 18a7c8b1
  lintangsutawika authored Jul 17, 2023
  
  18a7c8b1
- modified to arc_* · 1d995b6d
  lintangsutawika authored Jul 17, 2023
  
  1d995b6d
- Update anli_r3.yaml · 97a172ae
  Lintang Sutawika authored Jul 17, 2023
  
  97a172ae
- Update anli_r2.yaml · cd7f642d
  Lintang Sutawika authored Jul 17, 2023
  
  cd7f642d
- Update anli_r1.yaml · a7c1a639
  Lintang Sutawika authored Jul 17, 2023
  
  a7c1a639
- [Refactor] Migrate anli tasks to yaml · b783c68e
  Eddy Yeo authored Jul 17, 2023
  
  b783c68e
14 Jul, 2023 17 commits
- changes · e5161a6d
  lintangsutawika authored Jul 14, 2023
  
  e5161a6d
- add winogrande · 34fc9e68
  lintangsutawika authored Jul 05, 2023
  
  34fc9e68
- added include_benchmarks · 89c4ee5c
  lintangsutawika authored Jul 04, 2023
  
  89c4ee5c
- added benchmark configs · 1d3a1601
  lintangsutawika authored Jul 04, 2023
  
  1d3a1601
- change variable name · 15c186b7
  lintangsutawika authored Jul 04, 2023
  
  15c186b7
- added script to build benchmarks from promptsouce · e5306ea6
  lintangsutawika authored Jul 03, 2023
  
  e5306ea6
- update on how yaml file is made · 3713ec52
  lintangsutawika authored Jun 27, 2023
  
  3713ec52
- more tasks · ee098a47
  lintangsutawika authored Jun 21, 2023
  
  ee098a47
- changed name of boolq and cb config task · 7e565f33
  lintangsutawika authored Jun 21, 2023
  
  7e565f33
- override target_delimiter · a36348fa
  lintangsutawika authored Jul 14, 2023
  
  a36348fa
- fixed whitespace for target · addada53
  lintangsutawika authored Jul 14, 2023
  
  addada53
- adjustments for super_glue · b0597a94
  lintangsutawika authored Jul 14, 2023
  
  b0597a94
- formatted · f7dde0c3
  lintangsutawika authored Jul 14, 2023
  
  f7dde0c3
- updates, corrections, and fixes to match big-refactor · ee633332
  lintangsutawika authored Jul 14, 2023
  
  ee633332
- config fixes · 248b45da
  lintangsutawika authored Jul 14, 2023
  
  248b45da
- fixes to boolq · f4efb8e5
  lintangsutawika authored Jul 14, 2023
  
  f4efb8e5
- fixes to bollq · ae41f67c
  lintangsutawika authored Jul 14, 2023
  
  ae41f67c
13 Jul, 2023 11 commits
- Update README.md · 98c85d73
  Hailey Schoelkopf authored Jul 13, 2023
  
  98c85d73
- doc_to_choice can run when a promptsource template is defined · ce5ec854
  lintangsutawika authored Jul 13, 2023
  
  ce5ec854
- adjust wsc · 5288813a
  lintangsutawika authored Jul 13, 2023
  
  5288813a
- fixed doc_to_choice in race · e9432fad
  lintangsutawika authored Jul 13, 2023
  
  e9432fad
- adjust headqa · 9218bcff
  lintangsutawika authored Jul 13, 2023
  
  9218bcff
- adjust mathqa · f7a3cf20
  lintangsutawika authored Jul 13, 2023
  
  f7a3cf20
- adjust mathqa · a83874e5
  lintangsutawika authored Jul 13, 2023
  
  a83874e5
- fixes and added decontaminate args · 5dd41ebe
  lintangsutawika authored Jul 13, 2023
  
  5dd41ebe
- reformat · c827e4ce
  lintangsutawika authored Jul 13, 2023
  
  c827e4ce
- minor change · 9657b04c
  lintangsutawika authored Jul 13, 2023
  
  9657b04c
- update winogrande format · 5699c7ab
  lintangsutawika authored Jul 13, 2023
  
  5699c7ab
12 Jul, 2023 2 commits
- superglue add yamls · 5978dc4e
  lintangsutawika authored Jul 12, 2023
  
  5978dc4e
- Update README.md · 027efa00
  Hailey Schoelkopf authored Jul 12, 2023
  
  027efa00
11 Jul, 2023 3 commits
- updated yamls · 622bdda1
  lintangsutawika authored Jul 11, 2023
  
  622bdda1
- fixed arc · 31c52f55
  lintangsutawika authored Jul 11, 2023
  
  31c52f55
- modified yamls · fc5a114f
  lintangsutawika authored Jul 11, 2023
  
  fc5a114f