GitLab

Convert directly from llama3

The spelling of the term "request" has been corrected, which was previously mistakenly written as "requeset" in the error log message.

fix quantize file types

cache and reuse intermediate blobs

* feat: enable flash attention if supported

* feat: enable flash attention if supported

* feat: enable flash attention if supported

* feat: add flash_attn support

particularly useful for zipfiles and f16s

Don't return error on signal exit

Skip max queue test on remote

This test needs to be able to adjust the queue size down from
our default setting for a reliable test, so it needs to skip on
remote test execution mode.

changed line display to be calculated with runewidth

* Update README.md

Added chat/moderation bot to list of software.

* Update README.md

Fixed link error.

return on part done

Port cuda/rocm skip build vars to linux

Windows already implements these, carry over to linux.

Sanitize the env var debug log