• Daniel Hiltgen's avatar
    Harden for zero detected GPUs · f07f8b7a
    Daniel Hiltgen authored
    At least with the ROCm libraries, its possible to have the library
    present with zero GPUs.  This fix avoids a divide by zero bug in llm.go
    when we try to calculate GPU memory with zero GPUs.
    f07f8b7a
gpu.go 9.61 KB