Commits · cc572624746bd2e28b75ea7e8e32f1a9cee6b94c · gaoqiong / lm-evaluation-harness

06 Dec, 2023 2 commits
- add style 01 · cc572624
  lintangsutawika authored Dec 06, 2023
  
  cc572624
- removed mmlu altworlds · 50df117b
  lintangsutawika authored Dec 06, 2023
  
  50df117b
04 Dec, 2023 2 commits
- add \n\n to end of description · c30b71c3
  lintangsutawika authored Dec 04, 2023
  
  c30b71c3
- add \n\n to end of description · b32b3793
  lintangsutawika authored Dec 04, 2023
  
  b32b3793
28 Nov, 2023 2 commits
- reformat · 37a46351
  lintangsutawika authored Nov 28, 2023
  
  37a46351
- add versions · 0d03a9f3
  lintangsutawika authored Nov 28, 2023
  
  0d03a9f3
10 Nov, 2023 1 commit
- fixes · 69186ef2
  lintangsutawika authored Nov 10, 2023
  
  69186ef2
09 Nov, 2023 1 commit
- merged cont-metrics here · 6998762a
  lintangsutawika authored Nov 09, 2023
  
  6998762a
07 Nov, 2023 2 commits
- format · 0a39d055
  lintangsutawika authored Nov 07, 2023
  
  0a39d055
- add TED to BigBench and Brier score to MMLU · 2b7d8c2d
  lintangsutawika authored Nov 07, 2023
  
  2b7d8c2d
02 Nov, 2023 1 commit
- added group and task alias · 6dfe848e
  lintangsutawika authored Nov 02, 2023
  
  6dfe848e
01 Nov, 2023 1 commit
- replace with no_train mmlu dataset · f5cf38a9
  haileyschoelkopf authored Nov 01, 2023
  
  f5cf38a9
17 Oct, 2023 3 commits
- change all mentions of `greedy_until` to `generate_until` · c64bf9a9
  lintangsutawika authored Oct 17, 2023
  
  c64bf9a9
- added subgroups for other mmlu variants · 109ed1c7
  lintangsutawika authored Oct 17, 2023
  
  109ed1c7
- pre-commit reformat · c4f0bf75
  lintangsutawika authored Oct 17, 2023
  
  c4f0bf75
16 Oct, 2023 3 commits
- added stderr reprocessing for groups · 00859825
  lintangsutawika authored Oct 16, 2023
  
  00859825
- modfied to add subcategory · 92f25463
  lintangsutawika authored Oct 16, 2023
  
  92f25463
- added alt worlds prompts · b1ba4e71
  lintangsutawika authored Oct 16, 2023
  
  b1ba4e71
06 Oct, 2023 2 commits
- adjustments · 7d5e511c
  lintangsutawika authored Oct 06, 2023
  
  7d5e511c
- changed default to 5-shot · 2493c6cc
  lintangsutawika authored Oct 06, 2023
  
  2493c6cc
05 Oct, 2023 1 commit
- removed print messages, added cot extraction strings · 20a54b3a
  lintangsutawika authored Oct 05, 2023
  
  20a54b3a
26 Sep, 2023 1 commit
- Update _default_template_yaml · 3d2ee4d4
  Hailey Schoelkopf authored Sep 26, 2023
  
  3d2ee4d4
21 Sep, 2023 1 commit
- update · ea8b5beb
  lintangsutawika authored Sep 21, 2023
  
  ea8b5beb
04 Sep, 2023 4 commits
- update flan mmlu · 4a752867
  lintangsutawika authored Sep 04, 2023
  
  4a752867
- udpate · 03be40e2
  lintangsutawika authored Sep 04, 2023
  
  03be40e2
- edit group name · c8b76a3d
  lintangsutawika authored Sep 04, 2023
  
  c8b76a3d
- update · 06d3406e
  lintangsutawika authored Sep 04, 2023
  
  06d3406e
03 Sep, 2023 1 commit
- add mmlu variants · f23ae748
  lintangsutawika authored Sep 03, 2023
  
  f23ae748
08 Aug, 2023 3 commits
- fix choices · 9b00813f
  haileyschoelkopf authored Aug 08, 2023
  
  9b00813f
- add draft abstract algebra task, fix genning script · 620d8a36
  haileyschoelkopf authored Aug 08, 2023
  
  620d8a36
- add yaml-genning script + WIP base yaml · 25a4e2c6
  haileyschoelkopf authored Aug 08, 2023
  
  25a4e2c6