tests/mixed_int8/test_mixed_int8.py · e2e393c6f25205739b5dc9fddd460d7bfab85150 · chenpangpang / transformers

[`t5`] Fix T5 inference in `float16` + `bnb` error (#21281) · e2e393c6

Younes Belkada authored Jan 24, 2023

* attempts to fix:

- upcast input for `T5DenseActDense`
- add the condition `self.wo.weight.dtype != torch.int8`
- added tests on `test/mixed_int8`
- `make fixup`

* fix ci test

e2e393c6

test_mixed_int8.py 13 KB

Replace test_mixed_int8.py