GitLab

More robust shutdown

Detect AMD GPU info via sysfs and block old cards

This wires up some new logic to start using sysfs to discover AMD GPU
information and detects old cards we can't yet support so we can fallback to CPU mode.

Make sure that when a shutdown signal comes, we shutdown quickly instead
of waiting for a potentially long exchange to wrap up.

Ensure the libraries are present

When we store our libraries in a temp dir, a reaper might clean
them when we are idle, so make sure to check for them before
we reload.

Bump llama.cpp to b2081

runners

disable rocm builds

Accomodate split cuda lib dir

Co-authored-by: Erik Sp <git@aschwa.com>

Harden generate patching model

Only apply patches if we have any, and make sure to cleanup
every file we patched at the end to leave the tree clean

append image tags to user content

structured debug prompt