Skip to content

GitLab

Unverified Commit d79d9f07 authored by Wentao Ye's avatar Wentao Ye Committed by GitHub
Browse files

[Bug] Fix cpu disable shared_experts `VLLM_DISABLE_SHARED_EXPERTS_STREAM` (#28157) 


Signed-off-by: default avataryewentao256 <zhyanwentao@126.com>
parent b6a248bd
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/platforms/cpu.py
View file @ d79d9f07
......@@ -299,7 +299,7 @@ class CpuPlatform(Platform):
os.environ["TORCHINDUCTOR_COMPILE_THREADS"] = "1"
# Disable multi-stream for shared experts as no Stream on CPU
os.environ["VLLM_DISABLE_SHARED_EXPERTS_STREAM"] = "0"
os.environ["VLLM_DISABLE_SHARED_EXPERTS_STREAM"] = "1"
# Intel OpenMP setting
ld_preload_str = os.getenv("LD_PRELOAD", "")
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment