Skip to content

GitLab

Unverified Commit fc93e561 authored by Woosuk Kwon's avatar Woosuk Kwon Committed by GitHub
Browse files

[Bugfix][TPU] Correct env variable for XLA cache path (#7544)

parent 22b39e11
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/envs.py
View file @ fc93e561
...@@ -334,7 +334,7 @@ environment_variables: Dict[str, Callable[[], Any]] = { ...@@ -334,7 +334,7 @@ environment_variables: Dict[str, Callable[[], Any]] = {
"VLLM_XLA_CACHE_PATH": "VLLM_XLA_CACHE_PATH":
lambda: os.path.expanduser( lambda: os.path.expanduser(
os.getenv( os.getenv(
"VLLM_ASSETS_CACHE", "VLLM_XLA_CACHE_PATH",
os.path.join(get_default_cache_root(), "vllm", "xla_cache"), os.path.join(get_default_cache_root(), "vllm", "xla_cache"),
)), )),
"VLLM_FUSED_MOE_CHUNK_SIZE": "VLLM_FUSED_MOE_CHUNK_SIZE":
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment