GitLab

* parse wide argv characters on windows

* cleanup

* move cleanup to end of `main`

This should resolve a number of memory leak and stability defects by allowing
us to isolate llama.cpp in a separate process and shutdown when idle, and
gracefully restart if it has problems.  This also serves as a first step to be
able to run multiple copies to support multiple models concurrently.

The release just before ggml-cuda.cu refactoring

Signed-off-by: racerole <jiangyifeng@outlook.com>

Make sure that when a shutdown signal comes, we shutdown quickly instead
of waiting for a potentially long exchange to wrap up.

This requires an upstream change to support graceful termination,
carried as a patch.

This wires up logging in llama.cpp to always go to stderr, and also
turns up logging if OLLAMA_DEBUG is set.

Detect potential error scenarios so we can fallback to CPU mode without
hitting asserts.

This also refines the build process for the ext_server build.

In some cases we may want multiple variants for a given GPU type or CPU.
This adds logic to have an optional Variant which we can use to select
an optimal library, but also allows us to try multiple variants in case
some fail to load.

This can be useful for scenarios such as ROCm v5 vs v6 incompatibility
or potentially CPU features.

* update submodule to `6efb8eb30e7025b168f3fda3ff83b9b386428ad6`
* unblock condition variable in `update_slots` when closing server