Skip to content

GitLab

Unverified Commit 64a40a7a authored by Alberto Ferrer's avatar Alberto Ferrer Committed by GitHub
Browse files

[Bugfix] Fix typo in read_offset variable name (#33426) 


Signed-off-by: default avatarAlberto Ferrer <albertof@barrahome.org>
parent 31aedfe7
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/v1/engine/detokenizer.py
View file @ 64a40a7a
...@@ -280,7 +280,7 @@ class SlowIncrementalDetokenizer(BaseIncrementalDetokenizer): ...@@ -280,7 +280,7 @@ class SlowIncrementalDetokenizer(BaseIncrementalDetokenizer):
# Prompt embedding requests cannot be detokenized, in general. # Prompt embedding requests cannot be detokenized, in general.
self.tokens = [""] * self.prompt_len self.tokens = [""] * self.prompt_len
self.prefix_offset = 0 self.prefix_offset = 0
self.read_offest = 0 self.read_offset = 0
self.token_ids.extend(request.prompt_token_ids or [0] * self.prompt_len) self.token_ids.extend(request.prompt_token_ids or [0] * self.prompt_len)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment