Commits · c6839d72026c28ef70c2da7d11f355577d0bd8d3 · gaoqiong / lm-evaluation-harness

03 Jul, 2024 1 commit
- fixed sorting for multi-level printing · c6839d72
  haileyschoelkopf authored Jul 03, 2024
  
  c6839d72
02 Jul, 2024 10 commits
- Python tasks which subclass ConfigurableTask now run · e5811879
  haileyschoelkopf authored Jul 02, 2024
  
  e5811879
- don't use to-be-deprecated group: config field in overview notebook · f2e518ab
  haileyschoelkopf authored Jul 02, 2024
  
  f2e518ab
- switch mmlu variants over to using · 22b95671
  haileyschoelkopf authored Jul 02, 2024
  
  22b95671
- clean up diff · c1d9e625
  haileyschoelkopf authored Jul 02, 2024
  
  c1d9e625
- giving this a try · 3b7e6cc6
  haileyschoelkopf authored Jul 02, 2024
  
  3b7e6cc6
- fix merge conflicts? · d13b1f56
  haileyschoelkopf authored Jul 02, 2024
  
  d13b1f56
- Merge branch 'group-agg-rework' into group-agg-fixes · de4400c5
  haileyschoelkopf authored Jul 02, 2024
  
  de4400c5
- don't duplicate task names · fe5254ac
  haileyschoelkopf authored Jul 02, 2024
  
  fe5254ac
- update docs · 763a1c5e
  haileyschoelkopf authored Jul 02, 2024
  
  763a1c5e
- make KMMLU a tag for now · 30fbcfc9
  haileyschoelkopf authored Jul 02, 2024
  
  30fbcfc9
27 Jun, 2024 1 commit
- update task_id to be updateable and uses group:task format · 43765669
  lintangsutawika authored Jun 27, 2024
  
  43765669
25 Jun, 2024 6 commits
- some docs updates · 5251525d
  haileyschoelkopf authored Jun 25, 2024
  
  5251525d
- add more error msgs, agg_metric -> agg_metric_list · 93c17c57
  haileyschoelkopf authored Jun 25, 2024
  
  93c17c57
- add more explicit group configs · 09dd7f6c
  haileyschoelkopf authored Jun 25, 2024
  
  09dd7f6c
- add more explicit group configs · 8fdcbc13
  haileyschoelkopf authored Jun 25, 2024
  
  8fdcbc13
- add many explicit group configs · 51519e40
  haileyschoelkopf authored Jun 25, 2024
  
  51519e40
- add many explicit group configs · 44a602ab
  haileyschoelkopf authored Jun 25, 2024
  
  44a602ab
21 Jun, 2024 6 commits
- more groupings · c9801daf
  haileyschoelkopf authored Jun 21, 2024
  
  c9801daf
- add more groupings · c8693599
  haileyschoelkopf authored Jun 21, 2024
  
  c8693599
- add more groupings / tags distinctions · c171fa30
  haileyschoelkopf authored Jun 21, 2024
  
  c171fa30
- add more explicit aggregation groups · 46e8c8e6
  haileyschoelkopf authored Jun 21, 2024
  
  46e8c8e6
- add groups for agieval, aexams, aclue · a382359c
  haileyschoelkopf authored Jun 21, 2024
  
  a382359c
- some docs fixes · f48d87ec
  haileyschoelkopf authored Jun 21, 2024
  
  f48d87ec
10 Jun, 2024 15 commits
- update format · 5b527a71
  lintangsutawika authored Jun 10, 2024
  
  5b527a71
- update format · 83c070d4
  lintangsutawika authored Jun 10, 2024
  
  83c070d4
- update aggregate_metric arg · 5b64fb58
  lintangsutawika authored Jun 10, 2024
  
  5b64fb58
- change how aggregate_metric is loaded · 9fa3b3f4
  lintangsutawika authored Jun 10, 2024
  
  9fa3b3f4
- change how aggregate_metric is loaded · 80d0f412
  lintangsutawika authored Jun 10, 2024
  
  80d0f412
- Merge branch 'group-agg-rework' of... · 0f095f79
  lintangsutawika authored Jun 10, 2024
```
Merge branch 'group-agg-rework' of https://github.com/EleutherAI/lm-evaluation-harness into group-agg-rework
```
  0f095f79
- removed " " in make_table · e184c501
  lintangsutawika authored Jun 10, 2024
  
  e184c501
- update mmlu/ · ac1a1cef
  lintangsutawika authored Jun 10, 2024
  
  ac1a1cef
- Update docs/task_guide.md · 9e940f3d
  Lintang Sutawika authored Jun 10, 2024
```
Co-authored-by: Hailey Schoelkopf <65563625+haileyschoelkopf@users.noreply.github.com>
```
  9e940f3d
- Merge branch 'group-agg-rework' of... · b0028491
  lintangsutawika authored Jun 10, 2024
```
Merge branch 'group-agg-rework' of https://github.com/EleutherAI/lm-evaluation-harness into group-agg-rework
```
  b0028491
- remove version for metadata · 1848d664
  lintangsutawika authored Jun 10, 2024
  
  1848d664
- Update docs/task_guide.md · 26578d24
  Lintang Sutawika authored Jun 10, 2024
```
Co-authored-by: Hailey Schoelkopf <65563625+haileyschoelkopf@users.noreply.github.com>
```
  26578d24
- Merge branch 'group-agg-rework' of... · 016615fa
  lintangsutawika authored Jun 10, 2024
```
Merge branch 'group-agg-rework' of https://github.com/EleutherAI/lm-evaluation-harness into group-agg-rework
```
  016615fa
- remove group_alias · e8f49184
  lintangsutawika authored Jun 10, 2024
  
  e8f49184
- Update docs/task_guide.md · ed1f7574
  Lintang Sutawika authored Jun 10, 2024
```
Co-authored-by: Hailey Schoelkopf <65563625+haileyschoelkopf@users.noreply.github.com>
```
  ed1f7574
07 Jun, 2024 1 commit
- update all mmlu variants · 9a30374c
  lintangsutawika authored Jun 07, 2024
  
  9a30374c