GitLab

The token printed for authorized requests has a lifetime of 1h. If an
upload exceeds 1h, a chunk push will fail since the token is created on
a "start upload" request.

This replaces the Pipe with SectionReader which is simpler and
implements Seek, a requirement for makeRequestWithRetry. This is
slightly worse than using a Pipe since the progress update is directly
tied to the chunk size instead of controlled separately.

- re-use previously evaluated embeddings when possible
- change embeddings digest identifier to be based on model name and embedded file path

Co-Authored-By: Jeffrey Morgan <jmorganca@gmail.com>

- defer closing llm on embedding
- do not override licenses
- remove debugging print line
- reformat model file docs

Fixes #282

- default to embeddings enabled
- move embedding logic for loaded model to request
- allow embedding full directory
- close llm on reload

Fixes #297
Fixes #296

num_keep defines how many tokens to keep in the context when truncating
inputs. if left to its default value of -1, the server will calculate
num_keep to be the left of the system instructions