Skip to content

GitLab

Unverified Commit bcd2f74c authored by Zhengxu Chen's avatar Zhengxu Chen Committed by GitHub
Browse files

[compile] Clean up AOT compile bypass on evaluate_guards. (#33578) 


Signed-off-by: default avatarzhxchen17 <zhxchen17@fb.com>
parent f79f7778
Show whitespace changes
Inline Side-by-side
Showing with 0 additions and 8 deletions
vllm/compilation/wrapper.py
View file @ bcd2f74c
...@@ -151,14 +151,6 @@ class TorchCompileWithNoGuardsWrapper: ...@@ -151,14 +151,6 @@ class TorchCompileWithNoGuardsWrapper:
"requires VLLM_USE_BYTECODE_HOOK=0. " "requires VLLM_USE_BYTECODE_HOOK=0. "
) )
if envs.VLLM_USE_AOT_COMPILE:
# disabled until https://github.com/pytorch/pytorch/pull/169239
# is picked up.
assert ds_type != DynamicShapesType.BACKED, (
"evaluate_guards for backed shapes requires "
"VLLM_USE_AOT_COMPILE=False. "
)
options["guard_filter_fn"] = lambda x: [ options["guard_filter_fn"] = lambda x: [
entry.guard_type == "SHAPE_ENV" for entry in x entry.guard_type == "SHAPE_ENV" for entry in x
] ]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment