python/sglang/srt/layers/quantization/modelopt_quant.py · 21176b0093340b5d582fa39b5a2567f60bb69266 · zhaoyu6 / sglang

[Bugfix] Fix Weightloading for the original nvidia/Deepseek-R1-FP4 checkpoint (#9940) · 21176b00

Pavani Majety authored Sep 10, 2025


Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>

21176b00

modelopt_quant.py 53.9 KB

Replace modelopt_quant.py