vllm/utils/flashinfer.py · 03752dba8f1c4cd8eda99949b7d7ae90a47425d5 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[NVIDIA] Support Flashinfer TRTLLM FP8-q/kv/out Attention Kernel (#21716) · 03752dba

elvischenv authored Aug 19, 2025

Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

03752dba

flashinfer.py 9.91 KB