Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
1a0f4def
Unverified
Commit
1a0f4def
authored
Oct 22, 2025
by
Wentao Ye
Committed by
GitHub
Oct 22, 2025
Browse files
[Log] Add Warning for `LLM(data_parallel_size=k)` single-process DP Usage (#27282)
Signed-off-by:
yewentao256
<
zhyanwentao@126.com
>
parent
843af7f7
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
10 additions
and
0 deletions
+10
-0
vllm/entrypoints/llm.py
vllm/entrypoints/llm.py
+10
-0
No files found.
vllm/entrypoints/llm.py
View file @
1a0f4def
...
...
@@ -285,6 +285,16 @@ class LLM:
else
:
structured_outputs_instance
=
StructuredOutputsConfig
()
# warn about single-process data parallel usage.
_dps
=
int
(
kwargs
.
get
(
"data_parallel_size"
,
1
))
if
_dps
>
1
:
raise
ValueError
(
f
"LLM(data_parallel_size=
{
_dps
}
) is not supported for single-"
"process usage and may hang. Please use "
"the explicit multi-process data-parallel example at "
"'examples/offline_inference/data_parallel.py'."
)
engine_args
=
EngineArgs
(
model
=
model
,
runner
=
runner
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment