vllm/platforms/cuda.py · dea985aef01bde5f58fb0a9a6afb38ead4433e55 · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "5c76b9cdafb2abe205d675497f3ddb5603a07170"

[Attention] Default to FlashMLA backend for MLA (#14451) · b0d54194

Lucas Wilkinson authored Mar 08, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

b0d54194

cuda.py 17.1 KB

Replace cuda.py