vllm/attention/backends/blocksparse_attn.py · 82079729ccd0830ce77fcc5fd7ea2be3bf81ccaf · OpenDAS / vllm_cscc

[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799) · 8e192ff9

Eric Xihui Lin authored May 25, 2024


Co-authored-by: beagleski <yunanzhang@microsoft.com>
Co-authored-by: bapatra <bapatra@microsoft.com>
Co-authored-by: Barun Patra <codedecde@users.noreply.github.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

8e192ff9

blocksparse_attn.py 15.7 KB

Replace blocksparse_attn.py