Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
bb10e3a1
"vscode:/vscode.git/clone" did not exist on "037a4d103edff143db2f82e1feb8b5b80afea6f1"
Unverified
Commit
bb10e3a1
authored
Aug 16, 2025
by
Simo Lin
Committed by
GitHub
Aug 16, 2025
Browse files
[router] fix pd prefill http request complinace issue (#9237)
parent
fda762a2
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
6 deletions
+3
-6
sgl-router/src/routers/pd_router.rs
sgl-router/src/routers/pd_router.rs
+3
-6
No files found.
sgl-router/src/routers/pd_router.rs
View file @
bb10e3a1
...
@@ -886,12 +886,9 @@ impl PDRouter {
...
@@ -886,12 +886,9 @@ impl PDRouter {
tokio
::
spawn
(
async
move
{
tokio
::
spawn
(
async
move
{
if
let
Ok
(
response
)
=
prefill_future
.await
{
if
let
Ok
(
response
)
=
prefill_future
.await
{
// Consume at most one small chunk with a very short timeout to advance flow control
// Consume the entire response body to maintain HTTP compliance
let
_
=
tokio
::
time
::
timeout
(
Duration
::
from_millis
(
20
),
async
{
// This runs in the background and won't block the decode response
let
mut
s
=
response
.bytes_stream
();
let
_
=
response
.bytes
()
.await
;
let
_
=
s
.next
()
.await
;
})
.await
;
}
}
});
});
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment