Skip to content

GitLab

Unverified Commit 933f67ec authored by Yanan Cao's avatar Yanan Cao Committed by GitHub
Browse files

[Bugfix]Fix a conditional to not check zero value (#28754) 


Signed-off-by: default avatarYanan Cao <gmagogsfm@gmail.com>
parent fd65015a
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
vllm/compilation/caching.py
View file @ 933f67ec
......@@ -116,7 +116,8 @@ class VllmSerializableFunction(SerializableCallable):
the AOT compiled path.
"""
compile_inputs = [
inp or example_inputs[i] for i, inp in enumerate(fn.example_inputs)
inp if inp is not None else example_inputs[i]
for i, inp in enumerate(fn.example_inputs)
]
with tracing(TracingContext(fake_mode)):
fn.optimized_call = vllm_backend(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment