Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
4f065f12
Unverified
Commit
4f065f12
authored
Mar 18, 2025
by
Cody Yu
Committed by
GitHub
Mar 18, 2025
Browse files
[Misc][V1] Skip device checking if not available (#15061)
Signed-off-by:
Cody Yu
<
hao.yu.cody@gmail.com
>
parent
228b768d
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
0 deletions
+4
-0
vllm/engine/arg_utils.py
vllm/engine/arg_utils.py
+4
-0
No files found.
vllm/engine/arg_utils.py
View file @
4f065f12
...
...
@@ -1469,8 +1469,12 @@ class EngineArgs:
return
False
# Need at least Ampere for now (FA support required).
# Skip this check if we are running on a non-GPU platform,
# or if the device capability is not available
# (e.g. in a Ray actor without GPUs).
from
vllm.platforms
import
current_platform
if
(
current_platform
.
is_cuda
()
and
current_platform
.
get_device_capability
()
and
current_platform
.
get_device_capability
().
major
<
8
):
_raise_or_fallback
(
feature_name
=
"Compute Capability < 8.0"
,
recommend_to_remove
=
False
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment