GitLab

Also, document OLLAMA_HOST client semantics per command that honors it.
This looks nicer than having a general puprose environment variable
section in the root usage which was showing up after the "addition help
topics" section outputed by Cobra's default template.

It was decided this was easier to work with than using a custom template
for Cobra right now.

fix ci

Revamp ROCm support

remove empty examples

This refines where we extract the LLM libraries to by adding a new
OLLAMA_HOME env var, that defaults to `~/.ollama` The logic was already
idempotenent, so this should speed up startups after the first time a
new release is deployed.  It also cleans up after itself.

We now build only a single ROCm version (latest major) on both windows
and linux.  Given the large size of ROCms tensor files, we split the
dependency out.  It's bundled into the installer on windows, and a
separate download on windows.  The linux install script is now smart and
detects the presence of AMD GPUs and looks to see if rocm v6 is already
present, and if not, then downloads our dependency tar file.

For Linux discovery, we now use sysfs and check each GPU against what
ROCm supports so we can degrade to CPU gracefully instead of having
llama.cpp+rocm assert/crash on us.  For Windows, we now use go's windows
dynamic library loading logic to access the amdhip64.dll APIs to query
the GPU information.

adjust download and upload concurrency based on available bandwidth

Allow setting max vram for workarounds

Signed-off-by: hishope <csqiye@126.com>

Until we get all the memory calculations correct, this can provide
and escape valve for users to workaround out of memory crashes.

Updates #2944

* Add Odin Runes to README

Add Odin Runes to README

This commit adds Odin Runes to the "Community Integrations" section of the README. Odin Runes is a Java-based GPT client designed to provide seamless interaction with GPT models, enhancing productivity in prompt engineering and text generation tasks. This addition highlights the integration between Odin Runes and Ollama, offering users the flexibility to leverage large language models locally within their development workflow.

* Update README.md

this commit applies the comments of the reviewer.

* Added community link for Ollama Copilot

* Update README.md

---------
Co-authored-by: Michael <mchiang0610@users.noreply.github.com>

Add ollama user to video group

Add env var so podman will map cuda GPUs

Omit build date from gzip headers

instead of appending image tags, prepend them - this generally produces better results

On OpenSUSE, ollama needs to be a member of the video group
to access the GPU

Without this env var, podman's GPU logic doesn't map the GPU through

See https://reproducible-builds.org/ for why this is good.

This patch was done while working on reproducible builds for openSUSE.

Bump llama.cpp to b2276

Refine container image build script

Log unexpected server errors checking for update

This should unmask some failure modes that likely
show up in app logs as unmarshal errors

Allow overriding the platform, image name, and tag latest for
standard and rocm images.