src/transformers/models/mistral/modeling_mistral.py · 115ac94d062b1950467ac3dd521e2cd504f626db · chenpangpang / transformers · GitLab

Find file Blame History Permalink

[`Core generation`] Adds support for static KV cache (#27931) · 115ac94d

Arthur authored Feb 08, 2024

Co-authored-by: fxmarty <9808326+fxmarty@users.noreply.github.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

115ac94d

modeling_mistral.py 62.3 KB