Skip to content

GitLab

Unverified Commit 739daa63 authored by Liangsheng Yin's avatar Liangsheng Yin Committed by GitHub
Browse files

Adjust logits metada init for target verify (#11467)

parent d957177a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/model_executor/forward_batch_info.py
View file @ 739daa63
...@@ -393,7 +393,7 @@ class ForwardBatch: ...@@ -393,7 +393,7 @@ class ForwardBatch:
ret.positions = ret.spec_info.positions ret.positions = ret.spec_info.positions
# Init position information # Init position information
if ret.forward_mode.is_decode(): if ret.forward_mode.is_decode() or ret.forward_mode.is_target_verify():
if ret.positions is None: if ret.positions is None:
ret.positions = clamp_position(batch.seq_lens) ret.positions = clamp_position(batch.seq_lens)
else: else:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment