• 65a's avatar
    Use build tags to generate accelerated binaries for CUDA and ROCm on Linux. · f8ef4439
    65a authored
    The build tags rocm or cuda must be specified to both go generate and go build.
    ROCm builds should have both ROCM_PATH set (and the ROCM SDK present) as well
    as CLBlast installed (for GGML) and CLBlast_DIR set in the environment to the
    CLBlast cmake directory (likely /usr/lib/cmake/CLBlast). Build tags are also
    used to switch VRAM detection between cuda and rocm implementations, using
    added "accelerator_foo.go" files which contain architecture specific functions
    and variables. accelerator_none is used when no tags are set, and a helper
    function addRunner will ignore it if it is the chosen accelerator. Fix go
    generate commands, thanks @deadmeu for testing.
    f8ef4439
accelerator_none.go 429 Bytes