GitLab

The OLLAMA_MAX_VRAM env var was a temporary workaround for OOM
scenarios.  With Concurrency this was no longer wired up, and the simplistic
value doesn't map to multi-GPU setups.  Users can still set `num_gpu`
to limit memory usage to avoid OOM if we get our predictions wrong.

Adjust windows ROCm discovery

Refine scheduler unit tests for reliability

Fix context exhaustion integration test for small gpus

The v5 hip library returns unsupported GPUs which wont enumerate at
inference time in the runner so this makes sure we align discovery.  The
gfx906 cards are no longer supported so we shouldn't compile with that
GPU type as it wont enumerate at runtime.

add template validation to modelfile

* distinguish error forwarding

* more coverage

* rm comment

fix parsing tool calls: break on unexpected eofs

* server: only parse tool calls if tools are provided

* still set `resp.Message.Content`

parse tool call as individual objects

remove ToolCall from GenerateResponse

* reopen pr

* tools

* remove tc from stream for now

* ID and Function

* openai expects arguments to be a string (#5739)

* mutually exclusive content and tool calls

* clean up

---------
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

* add suffix

* remove todo

* remove TODO

* add to test

* rm outdated prompt tokens info md

* fix test

* fix test

remove unneeded tool calls

add insert support to generate endpoint

this change is triggered by the presence of "suffix", particularly
useful for code completion tasks

* Added AI Studio to the list of UIs

* OpenAI v1 models

* Empty List Testing

* Add back envconfig

* v1/models docs

* Remove Docs

* OpenAI batch embed compatibility

* merge conflicts

* integrate with api/embed

* ep

* merge conflicts

* request tests

* rm resp test

* merge conflict

* merge conflict

* test fixes

* test fn renaming

* input validation for empty string

---------
Co-authored-by: jmorganca <jmorganca@gmail.com>

fix unmarshal type errors

add chat and generate tests with mock runner

tools

* server: return empty slice on empty `/api/embed` request

* fix tests