Skip to content

GitLab

Unverified Commit a291439a authored by fzyzcjy's avatar fzyzcjy Committed by GitHub
Browse files

Support logprobs in two-batch overlap (#7709)

parent 54411f6a
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
python/sglang/srt/two_batch_overlap.py
View file @ a291439a
...@@ -550,6 +550,8 @@ class TboForwardBatchPreparer: ...@@ -550,6 +550,8 @@ class TboForwardBatchPreparer:
top_p_normalized_logprobs=False, top_p_normalized_logprobs=False,
top_p=None, top_p=None,
mm_inputs=None, mm_inputs=None,
top_logprobs_nums=None,
token_ids_logprobs=None,
) )
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment