• Jesse Gross's avatar
    ggml: Report ordinal IDs for AMD GPUs on Windows · 35fda7b4
    Jesse Gross authored
    We don't get valid UUIDs for AMD GPUs on Windows, so the best option
    is to use the ordinal IDs. This brings us in line with what we currently
    do on the Ollama server - the only exception is AMD GPUs on Linux, which
    falls back to using ordinal IDs. The GGML implementation has no fallback
    but it doesn't appear to occur for any of the GPUs that we support.
    
    It's also possible that there are collisions between ordinal IDs for
    different libraries - however the only places where we use them are
    AMD on Windows and Metal on Mac, which can never occur on the same
    system.
    35fda7b4
backend.go 12.3 KB