Skip to content

GitLab

Unverified Commit 3eb0c267 authored by QiliangCui's avatar QiliangCui Committed by GitHub
Browse files

[TPU] Support GCS path in VLLM_TORCH_PROFILER_DIR (#28487) 


Signed-off-by: default avatarQiliang Cui <derrhein@gmail.com>
parent d8140b98
Hide whitespace changes
Inline Side-by-side
Showing with 5 additions and 3 deletions
vllm/envs.py
View file @ 3eb0c267
...@@ -824,9 +824,11 @@ environment_variables: dict[str, Callable[[], Any]] = { ...@@ -824,9 +824,11 @@ environment_variables: dict[str, Callable[[], Any]] = {
# Note that it must be an absolute path. # Note that it must be an absolute path.
"VLLM_TORCH_PROFILER_DIR": lambda: ( "VLLM_TORCH_PROFILER_DIR": lambda: (
None None
if os.getenv("VLLM_TORCH_PROFILER_DIR", None) is None if (val := os.getenv("VLLM_TORCH_PROFILER_DIR")) is None
else os.path.abspath( else (
os.path.expanduser(os.getenv("VLLM_TORCH_PROFILER_DIR", ".")) val
if val.startswith("gs://") and val[5:] and val[5] != "/"
else os.path.abspath(os.path.expanduser(val))
) )
), ),
# Enable torch profiler to record shapes if set # Enable torch profiler to record shapes if set
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment