Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
5e125e74
Unverified
Commit
5e125e74
authored
Apr 03, 2025
by
youkaichao
Committed by
GitHub
Apr 03, 2025
Browse files
[misc] improve error message for "Failed to infer device type" (#15994)
Signed-off-by:
youkaichao
<
youkaichao@gmail.com
>
parent
06f21ce7
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
1 deletion
+4
-1
vllm/config.py
vllm/config.py
+4
-1
No files found.
vllm/config.py
View file @
5e125e74
...
@@ -1875,7 +1875,10 @@ class DeviceConfig:
...
@@ -1875,7 +1875,10 @@ class DeviceConfig:
from
vllm.platforms
import
current_platform
from
vllm.platforms
import
current_platform
self
.
device_type
=
current_platform
.
device_type
self
.
device_type
=
current_platform
.
device_type
if
not
self
.
device_type
:
if
not
self
.
device_type
:
raise
RuntimeError
(
"Failed to infer device type"
)
raise
RuntimeError
(
"Failed to infer device type, please set "
"the environment variable `VLLM_LOGGING_LEVEL=DEBUG` "
"to turn on verbose logging to help debug the issue."
)
else
:
else
:
# Device type is assigned explicitly
# Device type is assigned explicitly
self
.
device_type
=
device
self
.
device_type
=
device
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment