Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
4dbb34fe
"examples/pytorch/vscode:/vscode.git/clone" did not exist on "18dbaebebca7f236355ea44dd943b3e10b92901d"
Unverified
Commit
4dbb34fe
authored
Sep 04, 2025
by
wxsm
Committed by
GitHub
Sep 04, 2025
Browse files
fix: health_generate endpoint in mini_lb (#9997)
parent
1e18a341
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
python/sglang/srt/disaggregation/mini_lb.py
python/sglang/srt/disaggregation/mini_lb.py
+2
-2
No files found.
python/sglang/srt/disaggregation/mini_lb.py
View file @
4dbb34fe
...
...
@@ -187,7 +187,7 @@ async def health_check():
@
app
.
get
(
"/health_generate"
)
async
def
health_
check
():
async
def
health_
generate
():
prefill_servers
,
decode_servers
=
(
load_balancer
.
prefill_servers
,
load_balancer
.
decode_servers
,
...
...
@@ -196,7 +196,7 @@ async def health_check():
# Create the tasks
tasks
=
[]
for
server
in
chain
(
prefill_servers
,
decode_servers
):
tasks
.
append
(
session
.
pos
t
(
f
"
{
server
}
/health_generate"
))
tasks
.
append
(
session
.
ge
t
(
f
"
{
server
}
/health_generate"
))
for
i
,
response
in
enumerate
(
asyncio
.
as_completed
(
tasks
)):
await
response
return
Response
(
status_code
=
200
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment