Skip to content

GitLab

Unverified Commit 01653a91 authored by Angela Yi's avatar Angela Yi Committed by GitHub
Browse files

[compile] Fix inductor partition config (#26645) 


Signed-off-by: default avatarangelayi <yiangela7@gmail.com>
parent 0cd103e7
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 3 deletions
vllm/config/compilation.py
View file @ 01653a91
...@@ -709,9 +709,7 @@ class CompilationConfig: ...@@ -709,9 +709,7 @@ class CompilationConfig:
return self.level == CompilationLevel.PIECEWISE return self.level == CompilationLevel.PIECEWISE
# Inductor partition case # Inductor partition case
return ( return self.level > CompilationLevel.NO_COMPILATION and self.use_inductor
self.level > CompilationLevel.NO_COMPILATION and self.backend == "inductor"
)
def custom_op_log_check(self): def custom_op_log_check(self):
""" """
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment