benchmarks/kernels/benchmark_trtllm_decode_attention.py · 03752dba8f1c4cd8eda99949b7d7ae90a47425d5 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[NVIDIA] Support Flashinfer TRTLLM FP8-q/kv/out Attention Kernel (#21716) · 03752dba

elvischenv authored Aug 19, 2025

Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

03752dba

benchmark_trtllm_decode_attention.py 8.26 KB