Unverified Commit 5e125e74 authored by youkaichao's avatar youkaichao Committed by GitHub
Browse files

[misc] improve error message for "Failed to infer device type" (#15994)


Signed-off-by: default avataryoukaichao <youkaichao@gmail.com>
parent 06f21ce7
......@@ -1875,7 +1875,10 @@ class DeviceConfig:
from vllm.platforms import current_platform
self.device_type = current_platform.device_type
if not self.device_type:
raise RuntimeError("Failed to infer device type")
raise RuntimeError(
"Failed to infer device type, please set "
"the environment variable `VLLM_LOGGING_LEVEL=DEBUG` "
"to turn on verbose logging to help debug the issue.")
else:
# Device type is assigned explicitly
self.device_type = device
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment