vllm/model_executor/layers/quantization/modelopt.py · 6e672daf62e7b03ff1dcf74e4206dad07d39d4ec · OpenDAS / vllm_cscc

[NVIDIA] Add SM100 Flashinfer MoE per tensor scale fp8 backend (#21458) · 207b750e

amirkl94 authored Jul 31, 2025


Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

207b750e

modelopt.py 52.4 KB

Replace modelopt.py