vllm/model_executor/layers/quantization/fp8.py · 40de1ef455f20da0944f365681cf506892a536af · OpenDAS / vllm_cscc

[FEAT] [ROCm]: Add AITER Block-Scaled GEMM Feature (#14968) · 40de1ef4

vllmellm authored May 14, 2025


Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

40de1ef4

fp8.py 39.1 KB

Replace fp8.py