GitLab

Tmp cleaners can nuke the file out from underneath us.  This detects the missing
runner, and re-initializes the payloads.

Adds support for customizing GPU build flags in llama.cpp

fix: mixtral graph

Request and model concurrency

This change adds support for multiple concurrent requests, as well as
loading multiple models by spawning multiple runners. The default
settings are currently set at 1 concurrent request per model and only 1
loaded model at a time, but these can be adjusted by setting
OLLAMA_NUM_PARALLEL and OLLAMA_MAX_LOADED_MODELS.

Trim spaces and quotes from llm lib override

- move some popular integrations to the top of the lists

This reverts commit fad00a85.

* add chat (web UI) for LLM

I have used chat with llama3 in local successfully and the code is MIT licensed.

* Update README.md

---------
Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>

Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>

Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>

The goal of podman-ollama is to make AI even more boring.
Signed-off-by: Eric Curtin <ecurtin@redhat.com>

* add qa-pilot link

* format the link

* add shell-pilot

Fixed improper env references

Forgot a " on the write-host

Added OLLAMA_CUSTOM_CUDA_DEFS and OLLAMA_CUSTOM_ROCM_DEFS to customize GPU builds on Windows

Added OLLAMA_CUSTOM_CUDA_DEFS and OLLAMA_CUSTOM_ROCM_DEFS instead of OLLAMA_CUSTOM_GPU_DEFS

move Ollama static build to its own flag

update jetson tutorial

This also converges the old sep `:` to the new sep `-`.

add llama3 to readme

add stablelm graph calculation

fix padding to only return padding

types/model: support : in PartHost for host:port