Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
8865da15
Unverified
Commit
8865da15
authored
Oct 15, 2025
by
sangho.lee
Committed by
GitHub
Oct 15, 2025
Browse files
[Bugfix][Multi Modal] Fix incorrect Molmo token processing (#26873)
Signed-off-by:
sanghol
<
sanghol@allenai.org
>
parent
f0862eae
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
2 deletions
+5
-2
vllm/model_executor/models/molmo.py
vllm/model_executor/models/molmo.py
+5
-2
No files found.
vllm/model_executor/models/molmo.py
View file @
8865da15
...
...
@@ -1264,13 +1264,16 @@ class MolmoMultiModalProcessor(BaseMultiModalProcessor[MolmoProcessingInfo]):
)
->
list
[
int
]:
processor
=
self
.
info
.
get_hf_processor
()
# Apply the chat template to the tokens
# The chat template is already applied to the prompt tokens
# Use message_format="none" to avoid applying it again
# Prepend an empty space if `always_start_with_space` is True
tokens
=
processor
.
processor
.
get_tokens_input
(
# type: ignore
self
.
info
.
get_tokenizer
().
decode
(
prompt_tokens
),
message_format
=
processor
.
message_format
,
message_format
=
"none"
,
always_start_with_space
=
processor
.
always_start_with_space
,
)
# Prepend a BOS token id to the tokens
processed_data
=
self
.
info
.
ctx
.
call_hf_processor
(
processor
,
# type: ignore
dict
(
tokens
=
tokens
),
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment