Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
166a168b
Unverified
Commit
166a168b
authored
Mar 17, 2025
by
Cyrus Leung
Committed by
GitHub
Mar 17, 2025
Browse files
[Doc] Fix misleading log during multi-modal profiling (#14955)
Signed-off-by:
DarkLight1337
<
tlleungac@connect.ust.hk
>
parent
2bb0e1a7
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
1 deletion
+3
-1
vllm/multimodal/profiling.py
vllm/multimodal/profiling.py
+3
-1
No files found.
vllm/multimodal/profiling.py
View file @
166a168b
...
@@ -218,8 +218,10 @@ class MultiModalProfiler(Generic[_I]):
...
@@ -218,8 +218,10 @@ class MultiModalProfiler(Generic[_I]):
# V0 does not support chunked prefill.
# V0 does not support chunked prefill.
if
total_len
>
seq_len
and
not
envs
.
VLLM_USE_V1
:
if
total_len
>
seq_len
and
not
envs
.
VLLM_USE_V1
:
# `max_num_batched_tokens` is defined by `SchedulerConfig`
logger
.
warning
(
logger
.
warning
(
"The context length (%d) of the model is too short "
"The sequence length used for profiling ("
"max_num_batched_tokens / max_num_seqs = %d) is too short "
"to hold the multi-modal embeddings in the worst case "
"to hold the multi-modal embeddings in the worst case "
"(%d tokens in total, out of which %s are reserved for "
"(%d tokens in total, out of which %s are reserved for "
"multi-modal embeddings). This may cause certain "
"multi-modal embeddings). This may cause certain "
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment