Unverified Commit bb4fa95e authored by Avelina9X's avatar Avelina9X Committed by GitHub
Browse files

Update Legacy OpenLLM leaderboard to use "train" split for ARC fewshot (#2802)

* Update openllm.yaml to use train fewshot split for arc
parent 7021f000
### Changelog
- 2025-Mar-17 OpenLLM v2: Fixed few-shot split to correctly use train set for arc_challenge.
...@@ -2,7 +2,7 @@ group: openllm ...@@ -2,7 +2,7 @@ group: openllm
group_alias: Open LLM Leaderboard group_alias: Open LLM Leaderboard
task: task:
- task: arc_challenge - task: arc_challenge
fewshot_split: validation fewshot_split: train
num_fewshot: 25 num_fewshot: 25
- task: hellaswag - task: hellaswag
fewshot_split: train fewshot_split: train
...@@ -16,3 +16,5 @@ task: ...@@ -16,3 +16,5 @@ task:
num_fewshot: 5 num_fewshot: 5
- task: gsm8k - task: gsm8k
num_fewshot: 5 num_fewshot: 5
metadata:
version: 2
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment