vllm/model_executor/models/qwen2_moe.py · 8a924d2248dedb620eb9a32ca5c9f97ab525aaf5 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[CORE] Quantized lm-head Framework (#4442) · ee93f4f9
Qubitium-ModelCloud authored Jul 03, 2024
```
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
Co-authored-by: ZX <zx@lbx.dev>
```
ee93f4f9

qwen2_moe.py 18.7 KB