Skip to content

GitLab

Unverified Commit 91e87675 authored by Kevin H. Luu's avatar Kevin H. Luu Committed by GitHub
Browse files

[misc] Fix setup.py condition to avoid AMD from being mistaken with CPU (#13022) 


Signed-off-by: default avatarkevin <kevin@anyscale.com>
parent 08b2d845
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 2 deletions
setup.py
View file @ 91e87675
......@@ -48,8 +48,9 @@ elif not (sys.platform.startswith("linux")
"so vLLM may not be able to run correctly", sys.platform)
VLLM_TARGET_DEVICE = "empty"
elif (sys.platform.startswith("linux") and torch.version.cuda is None
and os.getenv("VLLM_TARGET_DEVICE") is None):
# if cuda is not available and VLLM_TARGET_DEVICE is not set,
and os.getenv("VLLM_TARGET_DEVICE") is None
and torch.version.hip is None):
# if cuda or hip is not available and VLLM_TARGET_DEVICE is not set,
# fallback to cpu
VLLM_TARGET_DEVICE = "cpu"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment