Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
8bd696fa
Unverified
Commit
8bd696fa
authored
Oct 08, 2025
by
Huy Do
Committed by
GitHub
Oct 09, 2025
Browse files
[Bugfix] Incorrect another MM data format in vllm bench throughput (#26462)
Signed-off-by:
Huy Do
<
huydhn@gmail.com
>
parent
bb6d8c21
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
8 deletions
+8
-8
vllm/benchmarks/throughput.py
vllm/benchmarks/throughput.py
+8
-8
No files found.
vllm/benchmarks/throughput.py
View file @
8bd696fa
...
...
@@ -59,16 +59,16 @@ def run_vllm(
prompts
:
list
[
Union
[
TextPrompt
,
TokensPrompt
]]
=
[]
sampling_params
:
list
[
SamplingParams
]
=
[]
for
request
in
requests
:
prompts
.
append
(
TokensPrompt
(
prompt_token_ids
=
request
.
prompt
[
"prompt_token_ids"
],
multi_modal_data
=
request
.
multi_modal_data
,
)
prompt
=
(
TokensPrompt
(
prompt_token_ids
=
request
.
prompt
[
"prompt_token_ids"
])
if
"prompt_token_ids"
in
request
.
prompt
else
TextPrompt
(
prompt
=
request
.
prompt
,
multi_modal_data
=
request
.
multi_modal_data
)
else
TextPrompt
(
prompt
=
request
.
prompt
)
)
if
request
.
multi_modal_data
:
assert
isinstance
(
request
.
multi_modal_data
,
dict
)
prompt
[
"multi_modal_data"
]
=
request
.
multi_modal_data
prompts
.
append
(
prompt
)
sampling_params
.
append
(
SamplingParams
(
n
=
n
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment