Commits · 5096772548ce1e72f401e3d80f771bfe0ee11ae2 · gaoqiong / lm-evaluation-harness

13 Dec, 2023 9 commits
- fixed style · 50967725
  lintangsutawika authored Dec 13, 2023
  
  50967725
- add styles 5 -8 · 5da401b0
  lintangsutawika authored Dec 13, 2023
  
  5da401b0
- fixed list · 3c5f347f
  lintangsutawika authored Dec 13, 2023
  
  3c5f347f
- removed comments · cd4ef5e8
  lintangsutawika authored Dec 13, 2023
  
  cd4ef5e8
- moved files · d5c6f0e5
  lintangsutawika authored Dec 13, 2023
  
  d5c6f0e5
- added mmlu alt world prompts · 0d5748b7
  lintangsutawika authored Dec 13, 2023
  
  0d5748b7
- removed · edb21d21
  lintangsutawika authored Dec 13, 2023
  
  edb21d21
- removed · 6e220b17
  lintangsutawika authored Dec 13, 2023
  
  6e220b17
- remove style · 09cac5dc
  lintangsutawika authored Dec 13, 2023
  
  09cac5dc
07 Dec, 2023 2 commits
- Update _mmlu_flan_cot_zeroshot_template_yaml · 8c05c6be
  Hailey Schoelkopf authored Dec 06, 2023
  
  8c05c6be
- Update _mmlu_flan_cot_fewshot_template_yaml · 4e34a6e8
  Hailey Schoelkopf authored Dec 06, 2023
  
  4e34a6e8
06 Dec, 2023 3 commits
- reformat · c74e2761
  lintangsutawika authored Dec 06, 2023
  
  c74e2761
- add style 01 · cc572624
  lintangsutawika authored Dec 06, 2023
  
  cc572624
- removed mmlu altworlds · 50df117b
  lintangsutawika authored Dec 06, 2023
  
  50df117b
04 Dec, 2023 2 commits
- add \n\n to end of description · c30b71c3
  lintangsutawika authored Dec 04, 2023
  
  c30b71c3
- add \n\n to end of description · b32b3793
  lintangsutawika authored Dec 04, 2023
  
  b32b3793
28 Nov, 2023 2 commits
- reformat · 37a46351
  lintangsutawika authored Nov 28, 2023
  
  37a46351
- add versions · 0d03a9f3
  lintangsutawika authored Nov 28, 2023
  
  0d03a9f3
10 Nov, 2023 1 commit
- fixes · 69186ef2
  lintangsutawika authored Nov 10, 2023
  
  69186ef2
09 Nov, 2023 1 commit
- merged cont-metrics here · 6998762a
  lintangsutawika authored Nov 09, 2023
  
  6998762a
07 Nov, 2023 2 commits
- format · 0a39d055
  lintangsutawika authored Nov 07, 2023
  
  0a39d055
- add TED to BigBench and Brier score to MMLU · 2b7d8c2d
  lintangsutawika authored Nov 07, 2023
  
  2b7d8c2d
02 Nov, 2023 1 commit
- added group and task alias · 6dfe848e
  lintangsutawika authored Nov 02, 2023
  
  6dfe848e
01 Nov, 2023 1 commit
- replace with no_train mmlu dataset · f5cf38a9
  haileyschoelkopf authored Nov 01, 2023
  
  f5cf38a9
17 Oct, 2023 3 commits
- change all mentions of `greedy_until` to `generate_until` · c64bf9a9
  lintangsutawika authored Oct 17, 2023
  
  c64bf9a9
- added subgroups for other mmlu variants · 109ed1c7
  lintangsutawika authored Oct 17, 2023
  
  109ed1c7
- pre-commit reformat · c4f0bf75
  lintangsutawika authored Oct 17, 2023
  
  c4f0bf75
16 Oct, 2023 3 commits
- added stderr reprocessing for groups · 00859825
  lintangsutawika authored Oct 16, 2023
  
  00859825
- modfied to add subcategory · 92f25463
  lintangsutawika authored Oct 16, 2023
  
  92f25463
- added alt worlds prompts · b1ba4e71
  lintangsutawika authored Oct 16, 2023
  
  b1ba4e71
06 Oct, 2023 2 commits
- adjustments · 7d5e511c
  lintangsutawika authored Oct 06, 2023
  
  7d5e511c
- changed default to 5-shot · 2493c6cc
  lintangsutawika authored Oct 06, 2023
  
  2493c6cc
05 Oct, 2023 1 commit
- removed print messages, added cot extraction strings · 20a54b3a
  lintangsutawika authored Oct 05, 2023
  
  20a54b3a
26 Sep, 2023 1 commit
- Update _default_template_yaml · 3d2ee4d4
  Hailey Schoelkopf authored Sep 26, 2023
  
  3d2ee4d4
21 Sep, 2023 1 commit
- update · ea8b5beb
  lintangsutawika authored Sep 21, 2023
  
  ea8b5beb
04 Sep, 2023 4 commits
- update flan mmlu · 4a752867
  lintangsutawika authored Sep 04, 2023
  
  4a752867
- udpate · 03be40e2
  lintangsutawika authored Sep 04, 2023
  
  03be40e2
- edit group name · c8b76a3d
  lintangsutawika authored Sep 04, 2023
  
  c8b76a3d
- update · 06d3406e
  lintangsutawika authored Sep 04, 2023
  
  06d3406e
03 Sep, 2023 1 commit
- add mmlu variants · f23ae748
  lintangsutawika authored Sep 03, 2023
  
  f23ae748