GitLab

prefer using req.Model and fallback to req.Name

Mechanical switch from log to slog

install: pin fedora to max 37

A few obvious levels were adjusted, but generally everything mapped to "info" level.

Updated readme with the web link for haystack ollama integration

Let gpu.go and gen_linux.sh also find CUDA on Arch Linux

Refine the linux cuda/rocm developer docs

Add multiple CPU variants for Intel Mac

The runners are x86 so we can only run binaries that match.

This also refines the build process for the ext_server build.

fix: normalize name path before splitting

Bump llama.cpp to b1842 and add new cuda lib dep

Upstream llama.cpp has added a new dependency with the
NVIDIA CUDA Driver Libraries (libcuda.so) which is part of the
driver distribution, not the general cuda libraries, and is not
available as an archive, so we can not statically link it.  This may
introduce some additional compatibility challenges which we'll
need to keep an eye on.

Add macos cross-compile CI coverage

repos for fedora 38 and newer do not exist as of this commit

```
$ dnf config-manager --add-repo https://developer.download.nvidia.com/compute/cuda/repos/fedora38/x86_64/cuda-fedora38.repo
Adding repo from: https://developer.download.nvidia.com/compute/cuda/repos/fedora38/x86_64/cuda-fedora38.repo
Status code: 404 for https://developer.download.nvidia.com/compute/cuda/repos/fedora38/x86_64/cuda-fedora38.repo (IP: 152.195.19.142)
Error: Configuration of repo failed
```

remove client.py

- prompt cache causes inferance to hang after some time

fix: request retry with error

improve cuda detection (rel. issue #1704)

Fix typo in arm mac arch script

Fix intel mac build

Make sure we're building an x86 ext_server lib when cross-compiling

remove double newlines in /set parameter

add max context length check

this fixes a subtle bug with makeRequestWithRetry where an HTTP status
error on a retried request will potentially not return the right err