Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
211c7b31
Unverified
Commit
211c7b31
authored
Apr 18, 2025
by
u4lr451
Committed by
GitHub
Apr 17, 2025
Browse files
Fix: Incorrect parameters passed to forward_batch_generation (#5506) (#5511)
parent
c08a717c
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
7 deletions
+4
-7
python/sglang/srt/speculative/eagle_worker.py
python/sglang/srt/speculative/eagle_worker.py
+4
-7
No files found.
python/sglang/srt/speculative/eagle_worker.py
View file @
211c7b31
...
@@ -271,14 +271,11 @@ class EAGLEWorker(TpModelWorker):
...
@@ -271,14 +271,11 @@ class EAGLEWorker(TpModelWorker):
)
)
elif
batch
.
forward_mode
.
is_idle
():
elif
batch
.
forward_mode
.
is_idle
():
model_worker_batch
=
batch
.
get_model_worker_batch
()
model_worker_batch
=
batch
.
get_model_worker_batch
()
logits_output
,
next_token_ids
,
_
=
(
logits_output
,
next_token_ids
=
self
.
target_worker
.
forward_batch_generation
(
self
.
target_worker
.
forward_batch_generation
(
model_worker_batch
ForwardBatch
.
init_new
(
model_worker_batch
,
self
.
target_worker
.
model_runner
)
)
)
)
return
logits_output
,
next_token_ids
,
model_worker_batch
.
bid
,
0
,
False
return
logits_output
,
next_token_ids
,
model_worker_batch
.
bid
,
0
else
:
else
:
logits_output
,
next_token_ids
,
bid
=
self
.
forward_target_extend
(
batch
)
logits_output
,
next_token_ids
,
bid
=
self
.
forward_target_extend
(
batch
)
with
self
.
draft_tp_context
(
self
.
draft_model_runner
.
tp_group
):
with
self
.
draft_tp_context
(
self
.
draft_model_runner
.
tp_group
):
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment