GitLab

This focuses on Windows first, but coudl be used for Mac
and possibly linux in the future.

This reverts commit 6920964b.

This reverts commit 2f9ed52b.

More robust shutdown

Detect AMD GPU info via sysfs and block old cards

This wires up some new logic to start using sysfs to discover AMD GPU
information and detects old cards we can't yet support so we can fallback to CPU mode.

Make sure that when a shutdown signal comes, we shutdown quickly instead
of waiting for a potentially long exchange to wrap up.

Ensure the libraries are present

When we store our libraries in a temp dir, a reaper might clean
them when we are idle, so make sure to check for them before
we reload.

Bump llama.cpp to b2081

runners

disable rocm builds

Accomodate split cuda lib dir