GitLab

This reverts commit bb46bbcf.

* Fix assert on small embedding inputs

* Update llm/patches/09-pooling.diff

On windows, if the model dir contained unicode characters
clip models would fail to load.  This fixes the file name
handling in clip.cpp to support utf16 on windows.

* llm: update llama.cpp submodule to `7c26775`

* disable `LLAMA_BLAS` for now

* `-DLLAMA_OPENMP=off`

* update llama.cpp submodule to `5921b8f089d3b7bda86aac5a66825df6a6c10603`

* add patch

This doesn't expose a UX yet, but wires the initial server portion
of progress reporting during load

* fix llava models not working after first request

* individual requests only for llava models

The release just before ggml-cuda.cu refactoring

This should resolve the problem where we don't fully unload from the GPU
when we go idle.

This requires an upstream change to support graceful termination,
carried as a patch.

* Fix clearing kv cache between requests with the same prompt

* fix powershell script