Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
8c25f9cf
Unverified
Commit
8c25f9cf
authored
Nov 20, 2025
by
Boyuan Feng
Committed by
GitHub
Nov 21, 2025
Browse files
[BugFix] skip combo kernel on cpu (#29129)
Signed-off-by:
Boyuan Feng
<
boyuan@meta.com
>
parent
56e96b37
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
0 deletions
+2
-0
vllm/config/compilation.py
vllm/config/compilation.py
+2
-0
No files found.
vllm/config/compilation.py
View file @
8c25f9cf
...
...
@@ -664,6 +664,8 @@ class CompilationConfig:
is_torch_equal_or_newer
(
"2.9.0.dev"
)
and
"combo_kernels"
not
in
self
.
inductor_compile_config
and
"benchmark_combo_kernel"
not
in
self
.
inductor_compile_config
# (fixme @boyuan) combo kernel does not support cpu yet.
and
not
current_platform
.
is_cpu
()
):
# use horizontal fusion, which is useful for fusing qk-norm and
# qk-rope when query and key have different shapes.
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment