Commits · 7d09b24c626edb1d4898ca73a5b53fe6adb3bc08 · gaoqiong / lm-evaluation-harness

03 Jul, 2024 1 commit
- update mmlu · e200c24e
  lintangsutawika authored Jul 03, 2024
  
  e200c24e
02 Jul, 2024 1 commit
- switch mmlu variants over to using · 22b95671
  haileyschoelkopf authored Jul 02, 2024
  
  22b95671
26 Jun, 2024 1 commit
- Fix `trust_remote_code`-related test failures (#2024) · e5e5ee0c
  Hailey Schoelkopf authored Jun 26, 2024
```
* make MMLU trust remote code to fix tests

* remove trust remote code
```
  e5e5ee0c
25 Jun, 2024 1 commit
- add many explicit group configs · 44a602ab
  haileyschoelkopf authored Jun 25, 2024
  
  44a602ab
10 Jun, 2024 3 commits
- update format · 83c070d4
  lintangsutawika authored Jun 10, 2024
  
  83c070d4
- update aggregate_metric arg · 5b64fb58
  lintangsutawika authored Jun 10, 2024
  
  5b64fb58
- update mmlu/ · ac1a1cef
  lintangsutawika authored Jun 10, 2024
  
  ac1a1cef
16 May, 2024 1 commit
- update mmlu · 104292ff
  lintangsutawika authored May 16, 2024
  
  104292ff
11 May, 2024 3 commits
- reformate · aef7028c
  lintangsutawika authored May 11, 2024
  
  aef7028c
- new mmlu config · 1960eb9a
  lintangsutawika authored May 11, 2024
  
  1960eb9a
- revert mmlu tasks · 0ffdee02
  lintangsutawika authored May 11, 2024
  
  0ffdee02
07 May, 2024 5 commits
- readd files · 75dfac43
  lintangsutawika authored May 07, 2024
  
  75dfac43
- update to work with new group and task configuration · ad70d206
  lintangsutawika authored May 07, 2024
  
  ad70d206
- update mmlu · c23c9305
  lintangsutawika authored May 07, 2024
  
  c23c9305
- update mmlu · cb085b02
  lintangsutawika authored May 07, 2024
  
  cb085b02
- adjust args · 09bc7c68
  lintangsutawika authored May 07, 2024
  
  09bc7c68
06 May, 2024 1 commit
- modify mmlu tasks · 96336194
  lintangsutawika authored May 06, 2024
  
  96336194
24 Apr, 2024 1 commit
- adjust mmlu to use group_config · 4dd69062
  lintangsutawika authored Apr 24, 2024
  
  4dd69062
23 Apr, 2024 1 commit
- add a group config that allows disabling table for group score and group aggregate in general · 6da6d187
  lintangsutawika authored Apr 23, 2024
  
  6da6d187
21 Dec, 2023 1 commit

Correctly Print Task Versioning (#1173) · 9cd79897

Hailey Schoelkopf authored Dec 21, 2023

* change version field formatting in metadata

* mention versioning in new task guide

* add instructions for changelog

* run linters

9cd79897

28 Nov, 2023 2 commits
- reformat · 37a46351
  lintangsutawika authored Nov 28, 2023
  
  37a46351
- add versions · 0d03a9f3
  lintangsutawika authored Nov 28, 2023
  
  0d03a9f3
10 Nov, 2023 1 commit
- fixes · 69186ef2
  lintangsutawika authored Nov 10, 2023
  
  69186ef2
02 Nov, 2023 1 commit
- added group and task alias · 6dfe848e
  lintangsutawika authored Nov 02, 2023
  
  6dfe848e
01 Nov, 2023 1 commit
- replace with no_train mmlu dataset · f5cf38a9
  haileyschoelkopf authored Nov 01, 2023
  
  f5cf38a9
17 Oct, 2023 1 commit
- added subgroups for other mmlu variants · 109ed1c7
  lintangsutawika authored Oct 17, 2023
  
  109ed1c7
16 Oct, 2023 2 commits
- added stderr reprocessing for groups · 00859825
  lintangsutawika authored Oct 16, 2023
  
  00859825
- modfied to add subcategory · 92f25463
  lintangsutawika authored Oct 16, 2023
  
  92f25463
06 Oct, 2023 2 commits
- adjustments · 7d5e511c
  lintangsutawika authored Oct 06, 2023
  
  7d5e511c
- changed default to 5-shot · 2493c6cc
  lintangsutawika authored Oct 06, 2023
  
  2493c6cc
26 Sep, 2023 1 commit
- Update _default_template_yaml · 3d2ee4d4
  Hailey Schoelkopf authored Sep 26, 2023
  
  3d2ee4d4
21 Sep, 2023 1 commit
- update · ea8b5beb
  lintangsutawika authored Sep 21, 2023
  
  ea8b5beb
04 Sep, 2023 2 commits
- update flan mmlu · 4a752867
  lintangsutawika authored Sep 04, 2023
  
  4a752867
- udpate · 03be40e2
  lintangsutawika authored Sep 04, 2023
  
  03be40e2
03 Sep, 2023 1 commit
- add mmlu variants · f23ae748
  lintangsutawika authored Sep 03, 2023
  
  f23ae748