Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
059d4cdb
Unverified
Commit
059d4cdb
authored
Jul 03, 2025
by
Nick Hill
Committed by
GitHub
Jul 02, 2025
Browse files
[BugFix] Fix DP headless mode arg validation (#20398)
Signed-off-by:
Nick Hill
<
nhill@redhat.com
>
parent
bdb84e26
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
4 deletions
+4
-4
vllm/entrypoints/cli/serve.py
vllm/entrypoints/cli/serve.py
+4
-4
No files found.
vllm/entrypoints/cli/serve.py
View file @
059d4cdb
...
@@ -119,6 +119,10 @@ def run_headless(args: argparse.Namespace):
...
@@ -119,6 +119,10 @@ def run_headless(args: argparse.Namespace):
if
not
envs
.
VLLM_USE_V1
:
if
not
envs
.
VLLM_USE_V1
:
raise
ValueError
(
"Headless mode is only supported for V1"
)
raise
ValueError
(
"Headless mode is only supported for V1"
)
if
engine_args
.
data_parallel_rank
is
not
None
:
raise
ValueError
(
"data_parallel_rank is not applicable in "
"headless mode"
)
parallel_config
=
vllm_config
.
parallel_config
parallel_config
=
vllm_config
.
parallel_config
local_engine_count
=
parallel_config
.
data_parallel_size_local
local_engine_count
=
parallel_config
.
data_parallel_size_local
...
@@ -126,10 +130,6 @@ def run_headless(args: argparse.Namespace):
...
@@ -126,10 +130,6 @@ def run_headless(args: argparse.Namespace):
raise
ValueError
(
"data_parallel_size_local must be > 0 in "
raise
ValueError
(
"data_parallel_size_local must be > 0 in "
"headless mode"
)
"headless mode"
)
if
parallel_config
.
data_parallel_rank
is
not
None
:
raise
ValueError
(
"data_parallel_rank is not applicable in "
"headless mode"
)
host
=
parallel_config
.
data_parallel_master_ip
host
=
parallel_config
.
data_parallel_master_ip
port
=
engine_args
.
data_parallel_rpc_port
# add to config too
port
=
engine_args
.
data_parallel_rpc_port
# add to config too
handshake_address
=
get_tcp_uri
(
host
,
port
)
handshake_address
=
get_tcp_uri
(
host
,
port
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment