GitLab

Ensure sparse files on windows during download

The file.Truncate call on windows will write the whole file
unless you set the sparse flag, leading to heavy I/O at the
beginning of download.  This should improve our
I/O behavior on windows and put less stress on the users disk.

fix concurrency test

Implement linux NUMA detection

use testing tempdirs

If the system has multiple numa nodes, enable numa support in llama.cpp
If we detect numactl in the path, use that, else use the basic "distribute" mode.

line feed

Users using `journalctl` to get logs for issue logging sometimes don't realize that paging is causing information to be missed.

enable gofmt/gofumpt/goimports/tenv

* Update docs

* token bug corrected

* Update docs/openai.md

* Update docs/openai.md

* add suffix

* merge conflicts

* merge conflicts

* docs without usage

* no usage

* rm metric note

* add prompt tokens to embed response

* rm slog

* metrics

* types

* prompt n

* clean up

* reset submodule

* add tokens to v1/embeddings

* separate usage

* OpenAI Docs

* Update docs/openai.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

* Remove newline

---------
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

Fix context in /api/generate grows too much (#5980).

refactor convert

fix modelfile message quotes

patches: phi3 optional sliding window attention

Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>