- 22 Dec, 2023 2 commits
-
-
Daniel Hiltgen authored
-
Daniel Hiltgen authored
The default thread count logic was broken and resulted in 2x the number of threads as it should on a hyperthreading CPU resulting in thrashing and poor performance.
-
- 19 Dec, 2023 4 commits
-
-
Daniel Hiltgen authored
-
Daniel Hiltgen authored
-
Daniel Hiltgen authored
Run the server.cpp directly inside the Go runtime via cgo while retaining the LLM Go abstractions.
-
Bruce MacDonald authored
- remove ggml runner - automatically pull gguf models when ggml detected - tell users to update to gguf in the case automatic pull fails Co-Authored-By:Jeffrey Morgan <jmorganca@gmail.com>
-
- 21 Nov, 2023 1 commit
-
-
Michael Yang authored
-
- 24 Oct, 2023 1 commit
-
-
Jeffrey Morgan authored
-
- 23 Oct, 2023 1 commit
-
-
Michael Yang authored
-
- 17 Oct, 2023 1 commit
-
-
Bruce MacDonald authored
-
- 21 Sep, 2023 1 commit
-
-
Michael Yang authored
-
- 20 Sep, 2023 1 commit
-
-
Michael Yang authored
-