Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
4d17e203
Unverified
Commit
4d17e203
authored
Apr 26, 2025
by
Lu Fang
Committed by
GitHub
Apr 26, 2025
Browse files
Disable the torch.compile cache checks when VLLM_DISABLE_COMPILE_CACHE=1 (#16573)
Signed-off-by:
Lu Fang
<
lufang@fb.com
>
parent
10fd1d73
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
9 additions
and
4 deletions
+9
-4
vllm/compilation/compiler_interface.py
vllm/compilation/compiler_interface.py
+9
-4
No files found.
vllm/compilation/compiler_interface.py
View file @
4d17e203
...
...
@@ -11,6 +11,7 @@ import torch
import
torch._inductor.compile_fx
import
torch.fx
as
fx
import
vllm.envs
as
envs
from
vllm.config
import
VllmConfig
from
vllm.utils
import
is_torch_equal_or_newer
...
...
@@ -317,6 +318,10 @@ class InductorAdaptor(CompilerInterface):
inner_compile
=
hijacked_compile_fx_inner
,
config_patches
=
current_config
)
# We treat VLLM_DISABLE_COMPILE_CACHE as the overall switch for torch
# compilation cache. So turn off the checks if we disable the
# compilation cache.
if
not
envs
.
VLLM_DISABLE_COMPILE_CACHE
:
assert
hash_str
is
not
None
,
(
"failed to get the hash of the compiled graph"
)
assert
file_path
is
not
None
,
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment