vllm/model_executor/layers/quantization/modelopt.py · 8ef50d9a6b91b7800e69a846219069a29a0298a4 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Kernel][Performance] Enable smaller Scaling Factor tiling for NVFP4 small-batch decoding (#30885) · 8ef50d9a

Roberto L. Castro authored Jan 14, 2026

Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>

8ef50d9a

modelopt.py 59.9 KB