vllm/platforms/cuda.py · b0d541947ab5b8c361077ee85df7b3a2138472f9 · OpenDAS / vllm_cscc

[Attention] Default to FlashMLA backend for MLA (#14451) · b0d54194

Lucas Wilkinson authored Mar 08, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

b0d54194

cuda.py 17.1 KB

Replace cuda.py