Skip to content

GitLab

Unverified Commit 57393715 authored by Nicolò Lucchesi's avatar Nicolò Lucchesi Committed by GitHub
Browse files

[Misc] `VLLM_TARGET_DEVICE.lower()` (#22101) 


Signed-off-by: default avatarNickLucche <nlucches@redhat.com>
parent ee2eb6ec
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/envs.py
View file @ 57393715
...@@ -213,7 +213,7 @@ environment_variables: dict[str, Callable[[], Any]] = { ...@@ -213,7 +213,7 @@ environment_variables: dict[str, Callable[[], Any]] = {
# Target device of vLLM, supporting [cuda (by default), # Target device of vLLM, supporting [cuda (by default),
# rocm, neuron, cpu] # rocm, neuron, cpu]
"VLLM_TARGET_DEVICE": "VLLM_TARGET_DEVICE":
lambda: os.getenv("VLLM_TARGET_DEVICE", "cuda"), lambda: os.getenv("VLLM_TARGET_DEVICE", "cuda").lower(),
# Maximum number of compilation jobs to run in parallel. # Maximum number of compilation jobs to run in parallel.
# By default this is the number of CPUs # By default this is the number of CPUs
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment