GitLab

* Use llama3.1 in tools example

* Update api.md

Users using `journalctl` to get logs for issue logging sometimes don't realize that paging is causing information to be missed.

* Update docs

* token bug corrected

* Update docs/openai.md

* Update docs/openai.md

* add suffix

* merge conflicts

* merge conflicts

* docs without usage

* no usage

* rm metric note

* OpenAI Docs

* Update docs/openai.md
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

* Remove newline

---------
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

The v5 hip library returns unsupported GPUs which wont enumerate at
inference time in the runner so this makes sure we align discovery.  The
gfx906 cards are no longer supported so we shouldn't compile with that
GPU type as it wont enumerate at runtime.

* add suffix

* remove todo

* remove TODO

* add to test

* rm outdated prompt tokens info md

* fix test

* fix test

This also adjusts our algorithm to favor our bundled ROCm.
I've confirmed VRAM reporting still doesn't work properly so we
can't yet enable concurrency by default.

We haven't found a workaround, so for now recommend updating.