GitLab

stub generate outputs for lint

refactor tensor read

More logging for gpu management

Fix an ordering glitch of dlerr/dlclose and add more logging to help
root cause some crashes users are hitting. This also refines the
function pointer names to use the underlying function names instead
of simplified names for readability.

Report more information about GPUs in verbose mode

This adds additional calls to both CUDA and ROCm management libraries to
discover additional attributes about the GPU(s) detected in the system, and
wires up runtime verbosity selection.  When users hit problems with GPUs we can
ask them to run with `OLLAMA_DEBUG=1 ollama serve` and share the results.

Set a default version using git describe

If a VERSION is not specified, this will generate a version string that
represents the state of the repo.  For example `0.1.21-12-gffaf52e1-dirty`
representing 12 commits away from 0.1.21 tag, on commit gffaf52e1
and the tree is dirty.

Refine Accelerate usage on mac

For old macs, accelerate seems to cause crashes, but for
AVX2 capable macs, it does not.

faq: update to use launchctl setenv

Refine debug logging for llm

Debug logging on init failure

This wires up logging in llama.cpp to always go to stderr, and also
turns up logging if OLLAMA_DEBUG is set.

fix: remove overwritten model layers

Make CPU builds parallel and customizable AMD GPUs

Probe GPUs before backend init

Detect potential error scenarios so we can fallback to CPU mode without
hitting asserts.

The linux build now support parallel CPU builds to speed things up.
This also exposes AMD GPU targets as an optional setting for advaced
users who want to alter our default set.

Combine the 2 Dockerfiles and add ROCm

This renames Dockerfile.build to Dockerfile, and adds some new stages
to support 2 modes of building - the build_linux.sh script uses
intermediate stages to extract the artifacts for ./dist, and the default
build generates a container image usable by both cuda and rocm cards.
This required transitioniing the x86 base to the rocm image to avoid
layer bloat.

if create overrides a manifest, first add the older manifest's layers to
the delete map so they can be cleaned up

More WSL paths

Switch to local dlopen symbols