GitLab

Merge pull request #1797 from sublimator/nd-allow-extension-origins-still-needs-explicit-listing-2024-01-05

fix: allow extension origins (still needs explicit listing), fixes #1686

- additional information is now available in show response, use this to pull gguf before running
- make gguf updates cancellable

* gpu: read memory info from all cuda devices

* add `LOOKUP_SIZE` constant

* better constant name

* address comments

update Dockerfile.build

Signed-off-by: Matt Williams <m@technovangelist.com>

Cleaup stale submodule

If the tree has a stale submodule, make sure we clean it up first

Revamp code layout for the llm directory and llama.cpp submodule

Load dynamic cpu lib on windows

On linux, we link the CPU library in to the Go app and fall back to it
when no GPU match is found. On windows we do not link in the CPU library
so that we can better control our dependencies for the CLI.  This fixes
the logic so we correctly fallback to the dynamic CPU library
on windows.

* update cmake flags for intel macOS

* remove `LLAMA_K_QUANTS`

* put back `CMAKE_OSX_DEPLOYMENT_TARGET` and disable `LLAMA_F16C`

Improve maintainability of Radeon card list

Fail fast on WSL1 while allowing on WSL2

Fix CPU only builds

Go embed doesn't like when there's no matching files, so put
a dummy placeholder in to allow building without any GPU support
If no "server" library is found, it's safely ignored at runtime.

This prevents users from accidentally installing on WSL1 with instructions
guiding how to upgrade their WSL instance to version 2.  Once running WSL2
if you have an NVIDIA card, you can follow their instructions to set up
GPU passthrough and run models on the GPU.  This is not possible on WSL1.

This moves the list of AMD GPUs to an easier to maintain list which
should make it easier to update over time.

Add ollama user to render group for Radeon support

For the ROCm libraries to access the driver, we need to add the ollama user
to the render group.

Fix windows system memory lookup

This refines the gpu package error handling and fixes a bug with the
system memory lookup on windows.