Skip to content

GitLab

Unverified Commit 2fa0e139 authored by Jee Jee Li's avatar Jee Jee Li Committed by GitHub
Browse files

[Bugfix] Fix torch.compile raise FileNotFoundError (#15278) 


Signed-off-by: default avatarJee Jee Li <pandaleefree@gmail.com>
parent 1c2bec0f
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
vllm/compilation/backends.py
View file @ 2fa0e139
......@@ -399,6 +399,7 @@ class VllmBackend:
rank = vllm_config.parallel_config.rank
dp_rank = vllm_config.parallel_config.data_parallel_rank
local_cache_dir = os.path.join(cache_dir, f"rank_{rank}_{dp_rank}")
os.makedirs(local_cache_dir, exist_ok=True)
self.compilation_config.local_cache_dir = local_cache_dir
disable_cache = envs.VLLM_DISABLE_COMPILE_CACHE
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment