vllm/model_executor/layers/quantization/gptq.py · db1e42f627f75ab455a157a03c6ebde33c8cbb1c · OpenDAS / vllm_cscc

[BUGFIX] GPTQ quantization compatibility for Qwen3 MOE models (AutoGPTQ and... · 183a7096

JartX authored Sep 01, 2025


[BUGFIX] GPTQ quantization compatibility for Qwen3 MOE models (AutoGPTQ and AutoRound-GPTQ) (#23994)
Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

183a7096

gptq.py 11.5 KB

Replace gptq.py