Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
9103ed16
Unverified
Commit
9103ed16
authored
Jan 11, 2026
by
Fadi Arafeh
Committed by
GitHub
Jan 10, 2026
Browse files
[CPU][BugFix] Disable AOT Compile for CPU (#32037)
Signed-off-by:
Fadi Arafeh
<
fadi.arafeh@arm.com
>
parent
46eb30f5
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
1 deletion
+6
-1
vllm/envs.py
vllm/envs.py
+6
-1
No files found.
vllm/envs.py
View file @
9103ed16
...
@@ -288,11 +288,16 @@ def use_aot_compile() -> bool:
...
@@ -288,11 +288,16 @@ def use_aot_compile() -> bool:
from
vllm.model_executor.layers.batch_invariant
import
(
from
vllm.model_executor.layers.batch_invariant
import
(
vllm_is_batch_invariant
,
vllm_is_batch_invariant
,
)
)
from
vllm.platforms
import
current_platform
from
vllm.utils.torch_utils
import
is_torch_equal_or_newer
from
vllm.utils.torch_utils
import
is_torch_equal_or_newer
default_value
=
(
default_value
=
(
"1"
"1"
if
is_torch_equal_or_newer
(
"2.10.0.dev"
)
and
not
disable_compile_cache
()
if
is_torch_equal_or_newer
(
"2.10.0.dev"
)
and
not
disable_compile_cache
()
# Disabling AOT_COMPILE for CPU
# See: https://github.com/vllm-project/vllm/issues/32033
and
not
current_platform
.
is_cpu
()
else
"0"
else
"0"
)
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment