@Narsil @drbh this will update flash attention v2 and vllm. You will need to re-install them.
Attach a file by drag & drop or click to upload
