GitLab

---------
Co-authored-by: Patrick Devine <patrick@infrahq.com>

* llm: limit generation to 10x context size to avoid run on generations

* add comment

* simplify condition statement

* api: start adding documentation to package api

Updates #2840

* Fix lint typo report

specfied -> specified

prefer using req.Model and fallback to req.Name

---------
Co-authored-by: Matt Apperson <mattapperson@Matts-MacBook-Pro.local>

This reverts commit 7a0899d6.

- update chat docs
- add messages chat endpoint
- remove deprecated context and template generate parameters from docs
- context and template are still supported for the time being and will continue to work as expected
- add partial response to chat history

* add `"format": "json"` as an API parameter
---------
Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>

- add the optional `raw` generate request parameter to bypass prompt formatting and response context
-add raw request to docs

- only reload the running llm if the model has changed, or the options for loading the running model have changed
- rename loaded llm to runner to differentiate from loaded model image
- remove logic which keeps the first system prompt in the generation context

- remove new lines from llama.cpp error messages relayed to client
- check api option types and return error on wrong type
- change num layers from 95% VRAM to 92% VRAM