"vscode:/vscode.git/clone" did not exist on "a2469127db6144eedb38d0b505287c0044e4ce06"
Unverified Commit 69196a9b authored by Aleksandr Malyshev's avatar Aleksandr Malyshev Committed by GitHub
Browse files

[BUGFIX] When skip_tokenize_init and multistep are set, execution crashes (#12277)


Signed-off-by: default avatarmaleksan85 <maleksan@amd.com>
Co-authored-by: default avatarmaleksan85 <maleksan@amd.com>
parent 2acba47d
......@@ -144,7 +144,7 @@ class MultiStepOutputProcessor(SequenceGroupOutputProcessor):
def _process_decode_and_stop(self, seq: Sequence,
sampling_params: SamplingParams) -> None:
new_char_count = 0
if sampling_params.detokenize:
if sampling_params.detokenize and self.detokenizer:
new_char_count = self.detokenizer.decode_sequence_inplace(
seq, sampling_params)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment