• Daniel Hiltgen's avatar
    Implement linux NUMA detection · f457d634
    Daniel Hiltgen authored
    If the system has multiple numa nodes, enable numa support in llama.cpp
    If we detect numactl in the path, use that, else use the basic "distribute" mode.
    f457d634
types.go 21.2 KB