Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
b73ac629
Unverified
Commit
b73ac629
authored
Sep 18, 2025
by
Ziming Huang
Committed by
GitHub
Sep 17, 2025
Browse files
[BugFix] Fix incorrect hidden_states_tensor in pd disaggregation + eagle (#9976)
parent
77098aea
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
3 deletions
+8
-3
python/sglang/srt/disaggregation/prefill.py
python/sglang/srt/disaggregation/prefill.py
+8
-3
No files found.
python/sglang/srt/disaggregation/prefill.py
View file @
b73ac629
...
...
@@ -421,6 +421,11 @@ class SchedulerDisaggregationPrefillMixin:
last_hidden_index
=
(
hidden_state_offset
+
extend_input_len_per_req
[
i
]
-
1
)
if
self
.
spec_algorithm
.
is_eagle3
():
req
.
hidden_states_tensor
=
(
batch
.
spec_info
.
hidden_states
[
i
].
cpu
().
clone
()
)
else
:
req
.
hidden_states_tensor
=
(
logits_output
.
hidden_states
[
last_hidden_index
].
cpu
().
clone
()
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment