vllm/lora/layers.py · ee93f4f92acbd9759a9af80747bc2a4459f07639 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[CORE] Quantized lm-head Framework (#4442) · ee93f4f9
Qubitium-ModelCloud authored Jul 03, 2024
```
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
Co-authored-by: ZX <zx@lbx.dev>
```
ee93f4f9

layers.py 48 KB