GitLab

Fix race in shutdown logic

Ensure the runners are terminated

Wait for GPU free memory reporting to converge

The GPU drivers take a while to update their free memory reporting, so we need
to wait until the values converge with what we're expecting before proceeding
to start another runner in order to get an accurate picture.

Record more GPU information

This cleans up the logging for GPU discovery a bit, and can
serve as a foundation to report GPU information in a future UX.

Harden subprocess reaping

routes: skip invalid filepaths

Doc container usage and workaround for nvidia errors

Updated sample code as per warning notification from the package maintainers

Add GPU usage

Detect noexec and report a better error

This records more GPU usage information for eventual UX inclusion.

* Add preflight OPTIONS handling and update CORS config

- Implement early return with HTTP 204 (No Content) for OPTIONS requests in allowedHostsMiddleware to optimize preflight handling.

- Extend CORS configuration to explicitly allow 'Authorization' headers and 'OPTIONS' method when OLLAMA_ORIGINS environment variable is set.

* allow auth, content-type, and user-agent headers

* Update routes.go

routes: fix show llava models

types/model: fix tag case

skip if same quantization

This will bubble up a much more informative error message if noexec
is preventing us from running the subprocess

fixing pip code.

* api: fill up API documentation

Followup for #2878

Now that the documentation is more complete, mention it in the README.

Updates #2840

* fix typo/lint

* Update README.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

---------
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

Some terminals may send line feed characters when pasting text with
newlines.

update list handler to use model.Name

quantize any fp16/fp32 model

- add test for number formatting
- fix bug where 1B and 1M were not stored correctly
- display 2 decimal points for million param sizes
- display 1 decimal point for billion param sizes