vllm/attention/backends/rocm_flash_attn.py · 6aae216b4e135e6f6889e0bc80efc8a666e264e8 · OpenDAS / vllm_cscc

[FEAT][ROCm] Integrate Paged Attention Kernel from AITER (#15001) · 0e237f00

vllmellm authored Apr 22, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

0e237f00

rocm_flash_attn.py 41 KB

Replace rocm_flash_attn.py