Unverified Commit 4f065f12 authored by Cody Yu's avatar Cody Yu Committed by GitHub
Browse files

[Misc][V1] Skip device checking if not available (#15061)


Signed-off-by: default avatarCody Yu <hao.yu.cody@gmail.com>
parent 228b768d
......@@ -1469,8 +1469,12 @@ class EngineArgs:
return False
# Need at least Ampere for now (FA support required).
# Skip this check if we are running on a non-GPU platform,
# or if the device capability is not available
# (e.g. in a Ray actor without GPUs).
from vllm.platforms import current_platform
if (current_platform.is_cuda()
and current_platform.get_device_capability()
and current_platform.get_device_capability().major < 8):
_raise_or_fallback(feature_name="Compute Capability < 8.0",
recommend_to_remove=False)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment