• Daniel Hiltgen's avatar
    Workaround broken NVIDIA iGPU free VRAM data (#12490) · e4340667
    Daniel Hiltgen authored
    The CUDA APIs for reporting free VRAM are useless on NVIDIA iGPU
    systems as they only return the kernels actual free memory and ignore
    buff/cache allocations which on a typical system will quickly fill up
    most of the free system memory.  As a result, we incorrectly think
    there's very little available for GPU allocations which is wrong.
    e4340667
runner.go 16.8 KB