GitLab

Implement linux NUMA detection

use testing tempdirs

If the system has multiple numa nodes, enable numa support in llama.cpp
If we detect numactl in the path, use that, else use the basic "distribute" mode.

line feed

Users using `journalctl` to get logs for issue logging sometimes don't realize that paging is causing information to be missed.

enable gofmt/gofumpt/goimports/tenv

* Update docs

* token bug corrected

* Update docs/openai.md

* Update docs/openai.md

* add suffix

* merge conflicts

* merge conflicts

* docs without usage

* no usage

* rm metric note

* add prompt tokens to embed response

* rm slog

* metrics

* types

* prompt n

* clean up

* reset submodule

* add tokens to v1/embeddings

* separate usage

* OpenAI Docs

* Update docs/openai.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

* Remove newline

---------
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

Fix context in /api/generate grows too much (#5980).

refactor convert

fix modelfile message quotes

patches: phi3 optional sliding window attention

Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

include modelfile messages

fix: environ lookup