docs/source/en/internal/generation_utils.md · 1e402b957d96597e5e47c06da5671ccec09621cc · chenpangpang / transformers · GitLab

Find file Blame History Permalink

[`Core generation`] Adds support for static KV cache (#27931) · 115ac94d

Arthur authored Feb 08, 2024

Co-authored-by: fxmarty <9808326+fxmarty@users.noreply.github.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

115ac94d

generation_utils.md 9.07 KB