src/transformers/modeling_utils.py · 266c67b06a3ce19e584af4a809d1aaa598113b2b · chenpangpang / transformers

[`Mixtral` / `Awq`] Add mixtral fused modules for Awq (#28240) · 266c67b0

Younes Belkada authored Jan 12, 2024



* add mixtral fused modules

* add changes from modeling utils

* add test

* fix test + rope theta issue

* Update src/transformers/modeling_utils.py
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

* add tests

---------
Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

266c67b0

modeling_utils.py 236 KB

Replace modeling_utils.py