Commits · 4ad6cd9fa22309058d827ecbbcad965c2fc618ca · gaoqiong / lm-evaluation-harness

25 Sep, 2025 11 commits
- remove deps; types · 4ad6cd9f
  Baber authored Jul 22, 2025
  
  4ad6cd9f
- make multiple_input explicit · 689e0c91
  Baber authored Jul 22, 2025
  
  689e0c91
- `check_gold_index_error` util; fix `process_results`; rm generate_until multiple-choice · d9876b22
  Baber authored Jul 22, 2025
  
  d9876b22
- improve metric aggregation default and higher-better checks; add `TaskConfig.from_template` · d19bd889
  Baber authored Jul 21, 2025
  
  d19bd889
- cleanup · 69d14fb3
  Baber authored Jul 21, 2025
  
  69d14fb3
- remove prompt-source for now · 70f5e2f0
  Baber authored Jul 18, 2025
  
  70f5e2f0
- refactor: improve dataset and metric handling in TaskConfig · 227f1a74
  Baber authored Jul 08, 2025
  
  227f1a74
- refactor: update type hints and improve filter ensemble construction · 3b4d0af1
  Baber authored Jul 08, 2025
  
  3b4d0af1
- cleanup · c81c03ee
  Baber authored Jul 08, 2025
  
  c81c03ee
- serialize better · 674611e9
  Baber authored Jul 05, 2025
  
  674611e9
- refactor configs to files · 57adbd35
  Baber authored Jul 04, 2025
  
  57adbd35