• Daniel Hiltgen's avatar
    Improve multi-gpu handling at the limit · 6fd04ca9
    Daniel Hiltgen authored
    Still not complete, needs some refinement to our prediction to understand the
    discrete GPUs available space so we can see how many layers fit in each one
    since we can't split one layer across multiple GPUs we can't treat free space
    as one logical block
    6fd04ca9
memory_test.go 3.94 KB