vllm/model_executor/models/deepseek_v2.py · eeceadaecc80cc51c4e9ddae0cb99a33d379452d · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[CORE] Quantized lm-head Framework (#4442) · ee93f4f9
Qubitium-ModelCloud authored Jul 03, 2024
```
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
Co-authored-by: ZX <zx@lbx.dev>
```
ee93f4f9

deepseek_v2.py 22.1 KB