GitLab

fly example

Revert "fix golangci workflow not enable gofmt and goimports"

This reverts commit 04f971c8.

* add details on kubernetes deployment and separate the testing process

* Update examples/kubernetes/README.md

thanks for suggesting this change, I agree with you and let's make this project better together !
Co-authored-by: JonZeolla <Zeolla@gmail.com>

---------
Co-authored-by: QIN Mélony <MQN1@dsone.3ds.com>
Co-authored-by: JonZeolla <Zeolla@gmail.com>

* Update README.md

Add Ollama for R - ollama-r library

* Update README.md

---------
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

llm: add minimum based on layer size

Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

* note on naming restrictions

else push would fail with cryptic
retrieving manifest 
Error: file does not exist
==> maybe change that in code too

* Update docs/import.md

---------
Co-authored-by: C-4-5-3 <154636388+C-4-5-3@users.noreply.github.com>
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

---------
Co-authored-by: Patrick Devine <patrick@infrahq.com>

Add -e to viewing logs in order to show end of ollama logs

User our bundled libraries (cuda) instead of the host library

* Update api.md

Changed the calculation of tps (token/s) in the documentation

* Update docs/api.md

---------
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

Support Fedoras standard ROCm location

Trying to live off the land for cuda libraries was not the right strategy.  We need to use the version we compiled against to ensure things work properly

Fix stale test logic

The model processing was recently changed to be deferred but
this test scenario hadn't been adjusted for that change in behavior.

Skip PhysX cudart library

Add CUDA Driver API for GPU discovery

Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>

* fix llava models not working after first request

* individual requests only for llava models

Centralize server config handling

This moves all the env var reading into one central module
and logs the loaded config once at startup which should
help in troubleshooting user server logs

---------
Co-authored-by: Patrick Devine <patrick@infrahq.com>

Make maximum pending request configurable