Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
b6e7e3d5
Unverified
Commit
b6e7e3d5
authored
Jul 09, 2025
by
Kunshang Ji
Committed by
GitHub
Jul 09, 2025
Browse files
[Intel GPU] support ray as distributed executor backend for XPU. (#20659)
Signed-off-by:
Kunshang Ji
<
kunshang.ji@intel.com
>
parent
e760fcef
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
3 additions
and
1 deletion
+3
-1
.buildkite/scripts/hardware_ci/run-xpu-test.sh
.buildkite/scripts/hardware_ci/run-xpu-test.sh
+2
-0
vllm/executor/ray_distributed_executor.py
vllm/executor/ray_distributed_executor.py
+1
-1
No files found.
.buildkite/scripts/hardware_ci/run-xpu-test.sh
View file @
b6e7e3d5
...
...
@@ -27,6 +27,8 @@ docker run \
"
${
image_name
}
"
\
sh
-c
'
VLLM_USE_V1=1 python3 examples/offline_inference/basic/generate.py --model facebook/opt-125m --block-size 64 --enforce-eager
VLLM_USE_V1=1 python3 examples/offline_inference/basic/generate.py --model facebook/opt-125m --block-size 64 --enforce-eager -tp 2 --distributed-executor-backend ray
VLLM_USE_V1=1 python3 examples/offline_inference/basic/generate.py --model facebook/opt-125m --block-size 64 --enforce-eager -tp 2 --distributed-executor-backend mp
cd tests
pytest -v -s v1/core
'
vllm/executor/ray_distributed_executor.py
View file @
b6e7e3d5
...
...
@@ -62,7 +62,7 @@ class RayDistributedExecutor(DistributedExecutorBase):
def
_init_executor
(
self
)
->
None
:
self
.
forward_dag
:
Optional
[
ray
.
dag
.
CompiledDAG
]
=
None
if
envs
.
VLLM_USE_V1
and
not
current_platform
.
is_xpu
()
:
if
envs
.
VLLM_USE_V1
:
# V1 uses SPMD worker and compiled DAG
os
.
environ
[
"VLLM_USE_RAY_SPMD_WORKER"
]
=
"1"
os
.
environ
[
"VLLM_USE_RAY_COMPILED_DAG"
]
=
"1"
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment