Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
64fceab8
Commit
64fceab8
authored
Dec 05, 2024
by
Byron Hsu
Committed by
zhyncs
Dec 06, 2024
Browse files
[router] use 2-gpu-runner (#2368)
parent
71e2a277
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
6 additions
and
2 deletions
+6
-2
.github/workflows/pr-test-rust.yml
.github/workflows/pr-test-rust.yml
+1
-1
rust/py_test/test_launch_server.py
rust/py_test/test_launch_server.py
+5
-1
No files found.
.github/workflows/pr-test-rust.yml
View file @
64fceab8
...
...
@@ -42,7 +42,7 @@ jobs:
e2e-rust
:
if
:
github.repository == 'sgl-project/sglang' || github.event_name == 'pull_request'
runs-on
:
1
-gpu-runner
runs-on
:
2
-gpu-runner
steps
:
-
name
:
Checkout code
uses
:
actions/checkout@v3
...
...
rust/py_test/test_launch_server.py
View file @
64fceab8
...
...
@@ -92,7 +92,11 @@ class TestEvalAccuracyMini(unittest.TestCase):
)
metrics
=
run_eval
(
args
)
self
.
assertGreaterEqual
(
metrics
[
"score"
],
0.65
)
score
=
metrics
[
"score"
]
THRESHOLD
=
0.65
passed
=
score
>=
THRESHOLD
msg
=
f
"MMLU test
{
'passed'
if
passed
else
'failed'
}
with score
{
score
:.
3
f
}
(threshold:
{
THRESHOLD
}
)"
self
.
assertGreaterEqual
(
score
,
THRESHOLD
,
msg
)
if
__name__
==
"__main__"
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment