Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
de071366
"examples/vscode:/vscode.git/clone" did not exist on "d70eade4f29744b84fa11805c9ea2244ec61625e"
Unverified
Commit
de071366
authored
Apr 23, 2025
by
Lianmin Zheng
Committed by
GitHub
Apr 23, 2025
Browse files
tune the threshold of gemma-2-27b-it in test_nightly_gsm8k_eval.py (#5677)
parent
e0673969
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
test/srt/test_nightly_gsm8k_eval.py
test/srt/test_nightly_gsm8k_eval.py
+1
-1
No files found.
test/srt/test_nightly_gsm8k_eval.py
View file @
de071366
...
...
@@ -24,7 +24,7 @@ MODEL_SCORE_THRESHOLDS = {
"meta-llama/Llama-3.1-8B-Instruct"
:
0.82
,
"mistralai/Mistral-7B-Instruct-v0.3"
:
0.58
,
"deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct"
:
0.85
,
"google/gemma-2-27b-it"
:
0.9
2
,
"google/gemma-2-27b-it"
:
0.9
1
,
"meta-llama/Llama-3.1-70B-Instruct"
:
0.95
,
"mistralai/Mixtral-8x7B-Instruct-v0.1"
:
0.64
,
"Qwen/Qwen2-57B-A14B-Instruct"
:
0.86
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment