Commits · e1ae8a2f52a68a66aca4233ad22bcf970861edd2 · gaoqiong / lm-evaluation-harness

10 Nov, 2023 1 commit
- fixes · 69186ef2
  lintangsutawika authored Nov 10, 2023
  
  69186ef2
02 Nov, 2023 1 commit
- added group and task alias · 6dfe848e
  lintangsutawika authored Nov 02, 2023
  
  6dfe848e
01 Nov, 2023 1 commit
- replace with no_train mmlu dataset · f5cf38a9
  haileyschoelkopf authored Nov 01, 2023
  
  f5cf38a9
17 Oct, 2023 3 commits
- change all mentions of `greedy_until` to `generate_until` · c64bf9a9
  lintangsutawika authored Oct 17, 2023
  
  c64bf9a9
- added subgroups for other mmlu variants · 109ed1c7
  lintangsutawika authored Oct 17, 2023
  
  109ed1c7
- pre-commit reformat · c4f0bf75
  lintangsutawika authored Oct 17, 2023
  
  c4f0bf75
16 Oct, 2023 2 commits
- added stderr reprocessing for groups · 00859825
  lintangsutawika authored Oct 16, 2023
  
  00859825
- modfied to add subcategory · 92f25463
  lintangsutawika authored Oct 16, 2023
  
  92f25463
06 Oct, 2023 2 commits
- adjustments · 7d5e511c
  lintangsutawika authored Oct 06, 2023
  
  7d5e511c
- changed default to 5-shot · 2493c6cc
  lintangsutawika authored Oct 06, 2023
  
  2493c6cc
05 Oct, 2023 1 commit
- removed print messages, added cot extraction strings · 20a54b3a
  lintangsutawika authored Oct 05, 2023
  
  20a54b3a
26 Sep, 2023 1 commit
- Update _default_template_yaml · 3d2ee4d4
  Hailey Schoelkopf authored Sep 26, 2023
  
  3d2ee4d4
21 Sep, 2023 1 commit
- update · ea8b5beb
  lintangsutawika authored Sep 21, 2023
  
  ea8b5beb
04 Sep, 2023 4 commits
- update flan mmlu · 4a752867
  lintangsutawika authored Sep 04, 2023
  
  4a752867
- udpate · 03be40e2
  lintangsutawika authored Sep 04, 2023
  
  03be40e2
- edit group name · c8b76a3d
  lintangsutawika authored Sep 04, 2023
  
  c8b76a3d
- update · 06d3406e
  lintangsutawika authored Sep 04, 2023
  
  06d3406e
03 Sep, 2023 1 commit
- add mmlu variants · f23ae748
  lintangsutawika authored Sep 03, 2023
  
  f23ae748
08 Aug, 2023 3 commits
- fix choices · 9b00813f
  haileyschoelkopf authored Aug 08, 2023
  
  9b00813f
- add draft abstract algebra task, fix genning script · 620d8a36
  haileyschoelkopf authored Aug 08, 2023
  
  620d8a36
- add yaml-genning script + WIP base yaml · 25a4e2c6
  haileyschoelkopf authored Aug 08, 2023
  
  25a4e2c6