server/text_generation_server/layers/bnb.py · 6c715f8183e27aad41c1928f978647d54c2ba395 · OpenDAS / text-generation-inference · GitLab

Find file Blame History Permalink

[Bug Fix] Update torch import reference in bnb quantization (#1902) · 6c715f81
Dhruv Srikanth authored May 15, 2024
```
# What does this PR do?

Fixes `Import Error` occurring from mismatch of usage between
torch.nn.Module and nn.Module.
```
6c715f81

bnb.py 3.51 KB