vllm/model_executor/layers/quantization/modelopt.py · 5de8d9f111242671beb6fdc28367df8796ce638f · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830) · 31d5c179
Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
31d5c179

modelopt.py 30.1 KB