GitLab

Refine the way we log GPU discovery to improve the non-debug
output, and report more actionable log messages when possible
to help users troubleshoot on their own.

pointer deref's weren't correct on a few libraries, which explains
some crashes on older systems or miswired symlinks for discovery libraries.

This library will give us the most reliable free VRAM reporting on windows
to enable concurrent model scheduling.

Now that we call the GPU discovery routines many times to
update memory, this splits initial discovery from free memory
updating.

This cleans up the logging for GPU discovery a bit, and can
serve as a foundation to report GPU information in a future UX.

We're seeing some corner cases with cudart which might be resolved by
switching to the driver API which comes bundled with the driver package