tests/quantization/test_bitsandbytes.py · ac49b59d8b01ffb9979e18e67b252d45410bc1e6 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Bugfix] bitsandbytes models fail to run pipeline parallel (#10200) · ac49b59d
HoangCongDuc authored Nov 14, 2024
```
Signed-off-by: Hoang Cong Duc <hoangcongducltt@gmail.com>
```
ac49b59d

test_bitsandbytes.py 6.1 KB