• Daniel Hiltgen's avatar
    Support multiple variants for a given llm lib type · 8da7bef0
    Daniel Hiltgen authored
    In some cases we may want multiple variants for a given GPU type or CPU.
    This adds logic to have an optional Variant which we can use to select
    an optimal library, but also allows us to try multiple variants in case
    some fail to load.
    
    This can be useful for scenarios such as ROCm v5 vs v6 incompatibility
    or potentially CPU features.
    8da7bef0
gpu_info_rocm.h 1.42 KB