Skip to content

GitLab

Unverified Commit 71eda0bb authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

Update Qwen1.5-MoE-W4A16-compressed-tensors.yaml (#16946)

parent 471fe656
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
.buildkite/lm-eval-harness/configs/Qwen1.5-MoE-W4A16-compressed-tensors.yaml
View file @ 71eda0bb
...@@ -4,8 +4,8 @@ tasks: ...@@ -4,8 +4,8 @@ tasks:
- name: "gsm8k" - name: "gsm8k"
metrics: metrics:
- name: "exact_match,strict-match" - name: "exact_match,strict-match"
value: 0.31 value: 0.30
- name: "exact_match,flexible-extract" - name: "exact_match,flexible-extract"
value: 0.47 value: 0.465
limit: 1319 limit: 1319
num_fewshot: 5 num_fewshot: 5
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment