Skip to content

GitLab

Unverified Commit 05cbbe20 authored by Kunshang Ji's avatar Kunshang Ji Committed by GitHub
Browse files

[XPU] use `ZE_AFFINITY_MASK` for device select on xpu (#21815) 


Signed-off-by: default avatarKunshang Ji <kunshang.ji@intel.com>
parent 65f311ce
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/platforms/xpu.py
View file @ 05cbbe20
...@@ -30,7 +30,7 @@ class XPUPlatform(Platform): ...@@ -30,7 +30,7 @@ class XPUPlatform(Platform):
# see https://github.com/ray-project/ray/blob/6a5eb5865eeb9ccf058a79b44f107e327e360673/python/ray/_private/accelerators/intel_gpu.py#L20 # noqa: E501 # see https://github.com/ray-project/ray/blob/6a5eb5865eeb9ccf058a79b44f107e327e360673/python/ray/_private/accelerators/intel_gpu.py#L20 # noqa: E501
ray_device_key: str = "GPU" ray_device_key: str = "GPU"
dist_backend: str = "ccl" # ccl | xccl dist_backend: str = "ccl" # ccl | xccl
device_control_env_var: str = "ONEAPI_DEVICE_SELECTOR" device_control_env_var: str = "ZE_AFFINITY_MASK"
@classmethod @classmethod
def get_attn_backend_cls(cls, selected_backend: _Backend, head_size: int, def get_attn_backend_cls(cls, selected_backend: _Backend, head_size: int,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment