vllm/model_executor/layers/quantization/gguf.py · dc13c99eedf837f22f60e9b5836abf147f5254f1 · OpenDAS / vllm_cscc

"vllm/model_executor/models/step3p5_mtp.py" did not exist on "751c492c6a90b7f5a9d7e273b7784f27ddd6e2fe"

fix(gguf): Disable bfloat16 for GGUF on blackwell device (#30408) · dc13c99e

Christina Norman authored Dec 12, 2025


Signed-off-by: Christina <truffle@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Christina Norman <christina@example.com>
Co-authored-by: Isotr0py <isotr0py@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

dc13c99e

gguf.py 22.8 KB

Replace gguf.py