Unverified Commit a00d6254 authored by Zhengxu Chen's avatar Zhengxu Chen Committed by GitHub
Browse files

[compile] Disable dynamo guards check for AOT compilation. (#27288)


Signed-off-by: default avatarzhxchen17 <zhxchen17@fb.com>
Co-authored-by: default avatarCyrus Leung <tlleungac@connect.ust.hk>
parent 05181cc5
......@@ -302,6 +302,7 @@ def _support_torch_compile(
start_monitoring_torch_compile(self.vllm_config)
loaded_fn = torch.compiler.load_compiled_function(f)
_verify_source_unchanged(loaded_fn.source_info(), self.vllm_config)
loaded_fn.disable_guard_check()
self.aot_compiled_fn = loaded_fn
except Exception as e:
if os.path.exists(aot_compilation_path):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment