csrc/attention/attention_kernels.cu · 8e192ff967b44b186ea02d30e49fddf656fdfe50 · OpenDAS / vllm_cscc

[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799) · 8e192ff9

Eric Xihui Lin authored May 25, 2024


Co-authored-by: beagleski <yunanzhang@microsoft.com>
Co-authored-by: bapatra <bapatra@microsoft.com>
Co-authored-by: Barun Patra <codedecde@users.noreply.github.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

8e192ff9

attention_kernels.cu 42.9 KB

Replace attention_kernels.cu