• Daniel Hiltgen's avatar
    Report more information about GPUs in verbose mode · 987c16b2
    Daniel Hiltgen authored
    This adds additional calls to both CUDA and ROCm management libraries to
    discover additional attributes about the GPU(s) detected in the system, and
    wires up runtime verbosity selection.  When users hit problems with GPUs we can
    ask them to run with `OLLAMA_DEBUG=1 ollama serve` and share the results.
    987c16b2
gpu.go 8.2 KB