GitLab

* Fix typo and improve readability

Summary:
* Rename updatAvailableMenuID to updateAvailableMenuID
* Replace unused cmd parameter with _ in RunServer function
* Fix typos in comments

(cherry picked from commit 5b8715f0b04773369e8eb1f9e6737995a0ab3ba7)

* Update api/client.go
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

---------
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

The previous value of 64 was WAY too high and unnecessary. It reached
diminishing returns and blew past it. This is a more reasonable number
for _most_ normal cases. For users on cloud servers with excellent
network quality, this will keep screaming for them, without hitting our
CDN limits. For users with relatively poor network quality, this will
keep them from saturating their network and causing other issues.

- fixes printf: non-constant format string in call to fmt.Printf
- fixes SA1032: arguments have the wrong order
- disables testifylint

Go back to a pinned Go version

Go version 1.22.6 is triggering AV false positives, so go back to 1.22.5

* load on empty input

* no load on invalid input

add conversion for microsoft phi 3 mini/medium 4k, 128k

* simplify input output

* direct comp

* in line image

* rm error pointer type

* update response testing

* lint

This reverts commit 8aac2243.

For simplicity, perform parallelization of embedding requests in the API handler instead of offloading this to the subprocess runner. This keeps the scheduling story simpler as it builds on existing parallel requests, similar to existing text completion functionality.

Don't allow loading models that would lead to memory exhaustion (across vram, system memory and disk paging). This check was already applied on Linux but should also be applied on Windows as well.

server/download.go: Fix a typo in log

Set *.png and *.ico to be treated as binary files.

removeall to remove non-empty temp dirs

This partially reverts b732beba. It
seems like explicitly setting all files to use line feeds was done due
to issues with the go linter, hence it can be restricted to those files
(https://github.com/ollama/ollama/pull/6235#issuecomment-2278745953).

Don't hard fail on sparse setup error

It seems this can fail in some casees, but proceed
with the download anyway.

Harden intel boostrap for nil pointers

Adjust arm cuda repo paths

Catch one more error log

Store layers inside manifests consistently as values.

Signed-off-by: Jitang Lei <leijitang@outlook.com>

Commit 1829fb61 ("manifest: Fix crash on startup when trying to clean up
unused files (#5840)") changed the config layer stored in manifests
from a pointer to a value. This was done in order to avoid potential
nil pointer dereferences after it is deserialized from JSON in the
event that the field is missing.

This changes the Layers slice to also be stored by value. This enables
consistency in handling across the two objects.

When creating a model the config layer is appended to the list of
layers and then the last layer is used as the config when writing the
manifest. This change directly uses the config layer to write the
manifest. There is no behavior change but it is less error prone.

* Use llama3.1 in tools example

* Update api.md