benchmarks/kernels/bench_per_token_quant_fp8.py · 302eb941f360aaac6936abc782e235b45da88699 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[FP8] Extend per-token-group quantization support to QuantFP8 (#24342) · cef32104

Tahsin Tunan authored Sep 17, 2025

Signed-off-by: Tahsin Tunan <tahsintunan@gmail.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

cef32104

bench_per_token_quant_fp8.py 7.95 KB