vllm/model_executor/layers/quantization/gguf.py · 1f1b1bc03bfa36dbd0d884cede6f4dcdf0937e25 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1][Quantization] Add CUDA graph compatible v1 GGUF support (#18646) · 1f1b1bc0
Isotr0py authored May 27, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Isotr0py <2037008807@qq.com>
```
1f1b1bc0

gguf.py 20.6 KB