Commits · a57ffba1be6aab24b1f4ff5ad264ca7fc37cc00f · gaoqiong / lm-evaluation-harness

25 Sep, 2025 21 commits
- fixup! merge · bcd6faaa
  Baber authored Sep 26, 2025
  
  bcd6faaa
- add create_cloze_choices function · 7551cc34
  Baber authored Sep 08, 2025
  
  7551cc34
- update template · 4097aad3
  Baber authored Sep 08, 2025
  
  4097aad3
- update default values; fixes · b89af51e
  Baber authored Jul 10, 2025
  
  b89af51e
- add tests · fadd26e4
  Baber authored Jul 04, 2025
  
  fadd26e4
- fix logging · 649ca8fc
  Baber authored Jul 04, 2025
  
  649ca8fc
- add subcommands · 61520ad6
  Baber authored Jul 04, 2025
  
  61520ad6
- move test one doc to method · 7cef4d38
  Baber authored Jul 23, 2025
  
  7cef4d38
- overload Task methods if callable in yaml dict · ec767666
  Baber authored Jul 23, 2025
  
  ec767666
- remove deps; types · 4ad6cd9f
  Baber authored Jul 22, 2025
  
  4ad6cd9f
- make multiple_input explicit · 689e0c91
  Baber authored Jul 22, 2025
  
  689e0c91
- `check_gold_index_error` util; fix `process_results`; rm generate_until multiple-choice · d9876b22
  Baber authored Jul 22, 2025
  
  d9876b22
- improve metric aggregation default and higher-better checks; add `TaskConfig.from_template` · d19bd889
  Baber authored Jul 21, 2025
  
  d19bd889
- cleanup · 69d14fb3
  Baber authored Jul 21, 2025
  
  69d14fb3
- ruff rules; types · 1768fd3b
  Baber authored Jul 19, 2025
  
  1768fd3b
- remove prompt-source for now · 70f5e2f0
  Baber authored Jul 18, 2025
  
  70f5e2f0
- refactor: improve dataset and metric handling in TaskConfig · 227f1a74
  Baber authored Jul 08, 2025
  
  227f1a74
- refactor: update type hints and improve filter ensemble construction · 3b4d0af1
  Baber authored Jul 08, 2025
  
  3b4d0af1
- cleanup · c81c03ee
  Baber authored Jul 08, 2025
  
  c81c03ee
- serialize better · 674611e9
  Baber authored Jul 05, 2025
  
  674611e9
- refactor configs to files · 57adbd35
  Baber authored Jul 04, 2025
  
  57adbd35