1. 22 Dec, 2023 1 commit
  2. 20 Dec, 2023 1 commit
    • Daniel Hiltgen's avatar
      Revamp the dynamic library shim · 7555ea44
      Daniel Hiltgen authored
      This switches the default llama.cpp to be CPU based, and builds the GPU variants
      as dynamically loaded libraries which we can select at runtime.
      
      This also bumps the ROCm library to version 6 given 5.7 builds don't work
      on the latest ROCm library that just shipped.
      7555ea44
  3. 19 Dec, 2023 3 commits
    • Daniel Hiltgen's avatar
      Build linux using ubuntu 20.04 · 89bbaafa
      Daniel Hiltgen authored
      This changes the container-based linux build to use an older Ubuntu
      distro to improve our compatibility matrix for older user machines
      89bbaafa
    • Daniel Hiltgen's avatar
      35934b2e
    • 65a's avatar
      Use build tags to generate accelerated binaries for CUDA and ROCm on Linux. · f8ef4439
      65a authored
      The build tags rocm or cuda must be specified to both go generate and go build.
      ROCm builds should have both ROCM_PATH set (and the ROCM SDK present) as well
      as CLBlast installed (for GGML) and CLBlast_DIR set in the environment to the
      CLBlast cmake directory (likely /usr/lib/cmake/CLBlast). Build tags are also
      used to switch VRAM detection between cuda and rocm implementations, using
      added "accelerator_foo.go" files which contain architecture specific functions
      and variables. accelerator_none is used when no tags are set, and a helper
      function addRunner will ignore it if it is the chosen accelerator. Fix go
      generate commands, thanks @deadmeu for testing.
      f8ef4439
  4. 13 Oct, 2023 2 commits
  5. 03 Oct, 2023 1 commit
  6. 29 Sep, 2023 1 commit
  7. 22 Sep, 2023 1 commit