Skip to content

GitLab

Unverified Commit f225ea7d authored by Kunshang Ji's avatar Kunshang Ji Committed by GitHub
Browse files

[XPU] Fix `compile_size` is `None` case. (#25433) 


Signed-off-by: default avatarKunshang Ji <kunshang.ji@intel.com>
parent fc97733d
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
vllm/platforms/xpu.py
View file @ f225ea7d
...@@ -113,6 +113,8 @@ class XPUPlatform(Platform): ...@@ -113,6 +113,8 @@ class XPUPlatform(Platform):
# lazy import to avoid circular import # lazy import to avoid circular import
from vllm.config import CompilationLevel, CUDAGraphMode from vllm.config import CompilationLevel, CUDAGraphMode
compilation_config = vllm_config.compilation_config compilation_config = vllm_config.compilation_config
if compilation_config.compile_sizes is None:
compilation_config.compile_sizes = []
assert compilation_config.cudagraph_mode == CUDAGraphMode.NONE, \ assert compilation_config.cudagraph_mode == CUDAGraphMode.NONE, \
"CUDA graph mode should be NONE on XPU" "CUDA graph mode should be NONE on XPU"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment