GitLab

fix quantize file types

cache and reuse intermediate blobs

* feat: enable flash attention if supported

* feat: enable flash attention if supported

* feat: enable flash attention if supported

* feat: add flash_attn support

particularly useful for zipfiles and f16s

Don't return error on signal exit

Skip max queue test on remote

This test needs to be able to adjust the queue size down from
our default setting for a reliable test, so it needs to skip on
remote test execution mode.

changed line display to be calculated with runewidth

* Update README.md

Added chat/moderation bot to list of software.

* Update README.md

Fixed link error.

return on part done

Port cuda/rocm skip build vars to linux

Windows already implements these, carry over to linux.

Sanitize the env var debug log

Only dump env vars we care about in the logs

count memory up to NumGPU if set by user

* Fixed the API endpoint /api/tags to return {models: []} instead of {models: null} when the model list is empty.

* Update server/routes.go

---------
Co-authored-by: Jeffrey Morgan <jmorganca@gmail.com>

Remove VRAM convergence check for windows