• Daniel Hiltgen's avatar
    Prevent partial loading on mixed GPU brands · 34542099
    Daniel Hiltgen authored
    In mult-brand GPU setups, if we couldn't fully load the model we
    would fall through the scheduler and mistakenly try to load across
    a mix of brands.  This makes sure we find the set of GPU(s) that
    best fit for the partial load.
    34542099
sched.go 28.2 KB