vllm/platforms/interface.py · 2e94b9cfbb411f04d8232cc0246a72e369a04173 · OpenDAS / vllm_cscc

[Attention] Flash MLA for V1 (#13867) · 2e94b9cf

Lucas Wilkinson authored Feb 27, 2025


Signed-off-by: Yang Chen <yangche@fb.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Yang Chen <yangche@fb.com>

2e94b9cf

interface.py 10.6 KB

Replace interface.py