• Daniel Hiltgen's avatar
    Detect CUDA OS Overhead · f6f759fc
    Daniel Hiltgen authored
    This adds logic to detect skew between the driver and
    management library which can be attributed to OS overhead
    and records that so we can adjust subsequent management
    library free VRAM updates and avoid OOM scenarios.
    f6f759fc
gpu.go 18.9 KB