- 26 Jan, 2024 2 commits
-
-
Daniel Hiltgen authored
This adds ROCm support back as a discrete image.
-
Daniel Hiltgen authored
The size increase for rocm support in the standard image is problematic We'll revisit multiple tags for rocm support in a follow up PR.
-
- 21 Jan, 2024 2 commits
-
-
Daniel Hiltgen authored
The linux build now support parallel CPU builds to speed things up. This also exposes AMD GPU targets as an optional setting for advaced users who want to alter our default set.
-
Daniel Hiltgen authored
This renames Dockerfile.build to Dockerfile, and adds some new stages to support 2 modes of building - the build_linux.sh script uses intermediate stages to extract the artifacts for ./dist, and the default build generates a container image usable by both cuda and rocm cards. This required transitioniing the x86 base to the rocm image to avoid layer bloat.
-
- 19 Dec, 2023 2 commits
-
-
Daniel Hiltgen authored
-
65a authored
The build tags rocm or cuda must be specified to both go generate and go build. ROCm builds should have both ROCM_PATH set (and the ROCM SDK present) as well as CLBlast installed (for GGML) and CLBlast_DIR set in the environment to the CLBlast cmake directory (likely /usr/lib/cmake/CLBlast). Build tags are also used to switch VRAM detection between cuda and rocm implementations, using added "accelerator_foo.go" files which contain architecture specific functions and variables. accelerator_none is used when no tags are set, and a helper function addRunner will ignore it if it is the chosen accelerator. Fix go generate commands, thanks @deadmeu for testing.
-
- 01 Dec, 2023 1 commit
-
-
Michael Yang authored
* docker: set PATH, LD_LIBRARY_PATH, and capabilities * example: update k8s gpu manifest
-
- 13 Oct, 2023 1 commit
-
-
Jeffrey Morgan authored
-
- 03 Oct, 2023 1 commit
-
-
Jeffrey Morgan authored
-
- 30 Sep, 2023 2 commits
-
-
Michael Yang authored
-
Jeffrey Morgan authored
-
- 29 Sep, 2023 1 commit
-
-
Michael Yang authored
-
- 27 Sep, 2023 1 commit
-
-
Jeffrey Morgan authored
-
- 22 Sep, 2023 1 commit
-
-
Michael Yang authored
-
- 14 Sep, 2023 1 commit
-
-
Michael Yang authored
-
- 06 Sep, 2023 1 commit
-
-
Michael Yang authored
-
- 12 Jul, 2023 1 commit
-
-
Jeffrey Morgan authored
-
- 08 Jul, 2023 1 commit
-
-
Jeffrey Morgan authored
-
- 06 Jul, 2023 2 commits
-
-
Jeffrey Morgan authored
-
Jeffrey Morgan authored
-
- 30 Jun, 2023 2 commits
-
-
Jeffrey Morgan authored
-
Jeffrey Morgan authored
-