1. 21 Jan, 2024 1 commit
    • Daniel Hiltgen's avatar
      Combine the 2 Dockerfiles and add ROCm · da72235e
      Daniel Hiltgen authored
      This renames Dockerfile.build to Dockerfile, and adds some new stages
      to support 2 modes of building - the build_linux.sh script uses
      intermediate stages to extract the artifacts for ./dist, and the default
      build generates a container image usable by both cuda and rocm cards.
      This required transitioniing the x86 base to the rocm image to avoid
      layer bloat.
      da72235e
  2. 19 Dec, 2023 2 commits
    • Daniel Hiltgen's avatar
      35934b2e
    • 65a's avatar
      Use build tags to generate accelerated binaries for CUDA and ROCm on Linux. · f8ef4439
      65a authored
      The build tags rocm or cuda must be specified to both go generate and go build.
      ROCm builds should have both ROCM_PATH set (and the ROCM SDK present) as well
      as CLBlast installed (for GGML) and CLBlast_DIR set in the environment to the
      CLBlast cmake directory (likely /usr/lib/cmake/CLBlast). Build tags are also
      used to switch VRAM detection between cuda and rocm implementations, using
      added "accelerator_foo.go" files which contain architecture specific functions
      and variables. accelerator_none is used when no tags are set, and a helper
      function addRunner will ignore it if it is the chosen accelerator. Fix go
      generate commands, thanks @deadmeu for testing.
      f8ef4439
  3. 01 Dec, 2023 1 commit
  4. 13 Oct, 2023 1 commit
  5. 03 Oct, 2023 1 commit
  6. 30 Sep, 2023 2 commits
  7. 29 Sep, 2023 1 commit
  8. 27 Sep, 2023 1 commit
  9. 22 Sep, 2023 1 commit
  10. 14 Sep, 2023 1 commit
  11. 06 Sep, 2023 1 commit
  12. 12 Jul, 2023 1 commit
  13. 08 Jul, 2023 1 commit
  14. 06 Jul, 2023 2 commits
  15. 30 Jun, 2023 2 commits