Unverified Commit cae98406 authored by Zhengxu Chen's avatar Zhengxu Chen Committed by GitHub
Browse files

[compile] Enable AOT compile with batch invariance mode. (#39201)


Signed-off-by: default avatarzhxchen17 <zhxchen17@fb.com>
Co-authored-by: default avatarmergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
parent 715681c1
...@@ -300,10 +300,7 @@ def use_aot_compile() -> bool: ...@@ -300,10 +300,7 @@ def use_aot_compile() -> bool:
else "0" else "0"
) )
return ( return os.environ.get("VLLM_USE_AOT_COMPILE", default_value) == "1"
not bool(int(os.getenv("VLLM_BATCH_INVARIANT", "0")))
and os.environ.get("VLLM_USE_AOT_COMPILE", default_value) == "1"
)
def use_mega_aot_artifact(): def use_mega_aot_artifact():
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment