Skip to content

GitLab

Unverified Commit f8f10718 authored by Daniel Hiltgen's avatar Daniel Hiltgen Committed by GitHub
Browse files

CUDA: verify CC is supported by target library (#13298)

parent d3e0a0de
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 5 deletions
ml/device.go
View file @ f8f10718
...@@ -509,11 +509,9 @@ func GetVisibleDevicesEnv(l []DeviceInfo) map[string]string { ...@@ -509,11 +509,9 @@ func GetVisibleDevicesEnv(l []DeviceInfo) map[string]string {
// to crash at inference time and requires deeper validation before we include // to crash at inference time and requires deeper validation before we include
// it in the supported devices list. // it in the supported devices list.
func (d DeviceInfo) NeedsInitValidation() bool { func (d DeviceInfo) NeedsInitValidation() bool {
// At this time the only library we know needs a 2nd pass is ROCm since // ROCm: rocblas will crash on unsupported devices.
// rocblas will crash on unsupported devices. We want to find those crashes // CUDA: verify CC is supported by the version of the library
// during bootstrap discovery so we can eliminate those GPUs before the user return d.Library == "ROCm" || d.Library == "CUDA"
// tries to run inference on them
return d.Library == "ROCm"
} }
// Set the init validation environment variable // Set the init validation environment variable
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment