Skip to content

GitLab

Unverified Commit 47fcb8ca authored by Frederik Gossen's avatar Frederik Gossen Committed by GitHub
Browse files

[Core] Pass donate_graph_module=True to standalone_compile (#39733) 


Signed-off-by: default avatarFrederik Gossen <frgossen@meta.com>
parent 191e3fda
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
vllm/compilation/compiler_interface.py
View file @ 47fcb8ca
...@@ -295,6 +295,9 @@ class InductorStandaloneAdaptor(CompilerInterface): ...@@ -295,6 +295,9 @@ class InductorStandaloneAdaptor(CompilerInterface):
}, },
} }
if is_torch_equal_or_newer("2.13.0.dev"):
compile_kwargs["donate_graph_module"] = True # type: ignore[assignment]
use_aot: bool = supports_aot and envs.VLLM_USE_MEGA_AOT_ARTIFACT use_aot: bool = supports_aot and envs.VLLM_USE_MEGA_AOT_ARTIFACT
# only add 'aot' parameter if both supported and enabled... # only add 'aot' parameter if both supported and enabled...
# this will set bundled_autograd_cache # this will set bundled_autograd_cache
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment