tests/quantization/test_bitsandbytes.py · e661d5946a424d2396b719c582faebdfe6f7421a · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[bitsandbytes]: support read bnb pre-quantized model (#5753) · 87525fab
dongmao zhang authored Jul 23, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
87525fab

test_bitsandbytes.py 3.68 KB