vllm/model_executor/models/phi3_small.py · 15aba081f33e6d048422df6dcdb94301d08d13e6 · OpenDAS / vllm_cscc

[Kernel][Backend][Model] Blocksparse flash attention kernel and Phi-3-Small model (#4799) · 8e192ff9

Eric Xihui Lin authored May 25, 2024


Co-authored-by: beagleski <yunanzhang@microsoft.com>
Co-authored-by: bapatra <bapatra@microsoft.com>
Co-authored-by: Barun Patra <codedecde@users.noreply.github.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

8e192ff9

phi3_small.py 15.9 KB

Replace phi3_small.py