vllm/compilation/activation_quant_fusion.py · 460a2b11004229ccba1f5d5200c541496c8cf513 · OpenDAS / vllm_cscc

[torch.compile] Add torch inductor pass for fusing silu_and_mul with... · 460a2b11

Sage Moore authored May 01, 2025


[torch.compile] Add torch inductor pass for fusing silu_and_mul with subsequent scaled_fp8_quant operations (#10867)
Signed-off-by: Sage Moore <sage@neuralmagic.com>

460a2b11

activation_quant_fusion.py 3.04 KB

Replace activation_quant_fusion.py