GitLab

Fix CPU-only build under Android Termux enviornment.

Update gpu.go initGPUHandles() to declare gpuHandles variable before
reading it. This resolves an "invalid memory address or nil pointer
dereference" error.

Update dyn_ext_server.c to avoid setting the RTLD_DEEPBIND flag under
__TERMUX__ (Android).

fix show handler

api: add model for all requests

ci: update setup-go action

prefer using req.Model and fallback to req.Name

Mechanical switch from log to slog

install: pin fedora to max 37

A few obvious levels were adjusted, but generally everything mapped to "info" level.

Updated readme with the web link for haystack ollama integration

Let gpu.go and gen_linux.sh also find CUDA on Arch Linux

Refine the linux cuda/rocm developer docs

Add multiple CPU variants for Intel Mac

The runners are x86 so we can only run binaries that match.

This also refines the build process for the ext_server build.

fix: normalize name path before splitting

Bump llama.cpp to b1842 and add new cuda lib dep

Upstream llama.cpp has added a new dependency with the
NVIDIA CUDA Driver Libraries (libcuda.so) which is part of the
driver distribution, not the general cuda libraries, and is not
available as an archive, so we can not statically link it.  This may
introduce some additional compatibility challenges which we'll
need to keep an eye on.

Add macos cross-compile CI coverage

repos for fedora 38 and newer do not exist as of this commit

```
$ dnf config-manager --add-repo https://developer.download.nvidia.com/compute/cuda/repos/fedora38/x86_64/cuda-fedora38.repo
Adding repo from: https://developer.download.nvidia.com/compute/cuda/repos/fedora38/x86_64/cuda-fedora38.repo
Status code: 404 for https://developer.download.nvidia.com/compute/cuda/repos/fedora38/x86_64/cuda-fedora38.repo (IP: 152.195.19.142)
Error: Configuration of repo failed
```

remove client.py

- prompt cache causes inferance to hang after some time

fix: request retry with error

improve cuda detection (rel. issue #1704)

Fix typo in arm mac arch script

Fix intel mac build