Skip to content

GitLab

Unverified Commit 23b899a8 authored by Aurick Qiao's avatar Aurick Qiao Committed by GitHub
Browse files

[Bugfix] fix detokenizer shallow copy (#5919)

parent 17c79f3c
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/transformers_utils/detokenizer.py
View file @ 23b899a8
...@@ -90,7 +90,7 @@ class Detokenizer: ...@@ -90,7 +90,7 @@ class Detokenizer:
prefix_offset = next_iter_prefix_offset prefix_offset = next_iter_prefix_offset
read_offset = next_iter_read_offset read_offset = next_iter_read_offset
if prev_tokens is None: if prev_tokens is None:
prev_tokens = next_iter_tokens prev_tokens = next_iter_tokens.copy()
else: else:
prev_tokens.extend(next_iter_tokens) prev_tokens.extend(next_iter_tokens)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment