vllm/attention/ops/blocksparse_attention/interface.py · b9e12416e56a1b2da86bbb7612b8789790a2b645 · OpenDAS / vllm_cscc

"vllm/model_executor/models/step3p5_mtp.py" did not exist on "cbf9221992bd17b1335632c4d9e1afb04c406200"

[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799) · 8e192ff9

Eric Xihui Lin authored May 25, 2024


Co-authored-by: beagleski <yunanzhang@microsoft.com>
Co-authored-by: bapatra <bapatra@microsoft.com>
Co-authored-by: Barun Patra <codedecde@users.noreply.github.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

8e192ff9

interface.py 9.07 KB

Replace interface.py