Skip to content

GitLab

Unverified Commit 71575961 authored by Li, Jiang's avatar Li, Jiang Committed by GitHub
Browse files

[CPU] Disable async schedule on CPU (#31525) 


Signed-off-by: default avatarjiang1.li <jiang1.li@intel.com>
parent ab1af6aa
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
vllm/platforms/cpu.py
View file @ 71575961
...@@ -193,6 +193,8 @@ class CpuPlatform(Platform): ...@@ -193,6 +193,8 @@ class CpuPlatform(Platform):
) )
scheduler_config = vllm_config.scheduler_config scheduler_config = vllm_config.scheduler_config
# async scheduling is not required on CPU
scheduler_config.async_scheduling = False
if ( if (
scheduler_config.enable_chunked_prefill scheduler_config.enable_chunked_prefill
or cache_config.enable_prefix_caching or cache_config.enable_prefix_caching
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment