tests/models/mistral/test_modeling_mistral.py · b09912c8f452ac485933ac0f86937aa01de3c398 · chenpangpang / transformers

Fix mistral generate for long prompt / response (#27548) · b09912c8

Yanan Xie authored Nov 27, 2023

* Fix mistral generate for long prompt / response

* Add unit test

* fix linter

* fix linter

* fix test

* add assisted generation test for mistral and load the model in 4 bit + fa2

b09912c8

test_modeling_mistral.py 21.2 KB

Replace test_modeling_mistral.py