• Daniel Hiltgen's avatar
    logs: fix bogus "0 MiB free" log line (#12590) · 850da848
    Daniel Hiltgen authored
    On the llama runner, after the recent GGML bump a new log line reports
    incorrect 0 MiB free after our patch to remove memory from the props.  This
    adjusts the llama.cpp code to fetch the actual free memory of the active device.
    850da848
0024-ggml-Enable-resetting-backend-devices.patch 6.73 KB