docs/backend/quantization.md · 95085d65e9d2f2ee1da3e6fd192d838b3636f85d · change / sglang · GitLab

Find file Blame History Permalink

[QUANT] Add GPTQModel Dynamic Quantization + `lm_head` Quantization (#3790) · 56a724eb
Qubitium-ModelCloud authored Mar 05, 2025
```
Signed-off-by: ZX-ModelCloud <zx@modelcloud.ai>
Co-authored-by: ZX-ModelCloud <zx@modelcloud.ai>
```
56a724eb

quantization.md 6.12 KB