1. 19 Dec, 2023 1 commit
    • 65a's avatar
      Use build tags to generate accelerated binaries for CUDA and ROCm on Linux. · f8ef4439
      65a authored
      The build tags rocm or cuda must be specified to both go generate and go build.
      ROCm builds should have both ROCM_PATH set (and the ROCM SDK present) as well
      as CLBlast installed (for GGML) and CLBlast_DIR set in the environment to the
      CLBlast cmake directory (likely /usr/lib/cmake/CLBlast). Build tags are also
      used to switch VRAM detection between cuda and rocm implementations, using
      added "accelerator_foo.go" files which contain architecture specific functions
      and variables. accelerator_none is used when no tags are set, and a helper
      function addRunner will ignore it if it is the chosen accelerator. Fix go
      generate commands, thanks @deadmeu for testing.
      f8ef4439