Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
309a8f66
Unverified
Commit
309a8f66
authored
Jan 07, 2026
by
Cyrus Leung
Committed by
GitHub
Jan 07, 2026
Browse files
[Bugfix] Handle mistral tokenizer in get_hf_processor (#31817)
Signed-off-by:
DarkLight1337
<
tlleungac@connect.ust.hk
>
parent
e5d427e9
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
7 additions
and
1 deletion
+7
-1
vllm/multimodal/processing.py
vllm/multimodal/processing.py
+7
-1
No files found.
vllm/multimodal/processing.py
View file @
309a8f66
...
...
@@ -1186,10 +1186,16 @@ class InputProcessingContext:
typ
=
ProcessorMixin
from
vllm.tokenizers.mistral
import
MistralTokenizer
tokenizer
=
self
.
tokenizer
if
isinstance
(
tokenizer
,
MistralTokenizer
):
tokenizer
=
tokenizer
.
transformers_tokenizer
return
cached_processor_from_config
(
self
.
model_config
,
processor_cls
=
typ
,
tokenizer
=
self
.
tokenizer
,
tokenizer
=
tokenizer
,
**
kwargs
,
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment