Skip to content

GitLab

Unverified Commit e7296b08 authored by Angela Yi's avatar Angela Yi Committed by GitHub
Browse files

[bugfix] Pass globals to aot_compiled function (#29428) 


Signed-off-by: default avatarangelayi <yiangela7@gmail.com>
parent da7bc54e
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 1 deletion
vllm/compilation/decorators.py
View file @ e7296b08
...@@ -409,7 +409,9 @@ def _support_torch_compile( ...@@ -409,7 +409,9 @@ def _support_torch_compile(
open(aot_compilation_path, "rb") as f, open(aot_compilation_path, "rb") as f,
): ):
start_monitoring_torch_compile(self.vllm_config) start_monitoring_torch_compile(self.vllm_config)
loaded_fn = torch.compiler.load_compiled_function(f) loaded_fn = torch.compiler.load_compiled_function(
f, f_globals=self.forward.__globals__
)
_verify_source_unchanged(loaded_fn.source_info(), self.vllm_config) _verify_source_unchanged(loaded_fn.source_info(), self.vllm_config)
loaded_fn.disable_guard_check() loaded_fn.disable_guard_check()
self.aot_compiled_fn = loaded_fn self.aot_compiled_fn = loaded_fn
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment