benchmarks/kernels/bench_per_token_quant_fp8.py · 493b10f8bf38495654baa601e8ed8dc4ce1565b7 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830) · 31d5c179
Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
31d5c179

bench_per_token_quant_fp8.py 3.15 KB