Skip to content

GitLab

Unverified Commit d707678d authored by Zhuohan Li's avatar Zhuohan Li Committed by GitHub
Browse files

Fix num_logprobs parameter description in sampler.py (#34451) 


Signed-off-by: default avatarZhuohan Li <zhuohan123@gmail.com>
parent fc22cae4
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/v1/sample/sampler.py
View file @ d707678d
...@@ -217,7 +217,7 @@ class Sampler(nn.Module): ...@@ -217,7 +217,7 @@ class Sampler(nn.Module):
Args: Args:
logprobs: (num tokens) x (vocab) tensor logprobs: (num tokens) x (vocab) tensor
num_logprobs: minimum number of logprobs to num_logprobs: maximum number of logprobs to
retain per token retain per token
token_ids: prompt tokens (if prompt logprobs) token_ids: prompt tokens (if prompt logprobs)
or sampled tokens (if sampled or sampled tokens (if sampled
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment