examples/offline_inference/gguf_inference.py · afd0da2186c1d58fb48e138df0a2f548612b5d7d · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Model] Support GGUF models newly added in `transformers` 4.46.0 (#9685) · d14e98d9
Isotr0py authored Jan 13, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
d14e98d9

gguf_inference.py 1.05 KB