tests/models/llama/test_modeling_llama.py · 115ac94d062b1950467ac3dd521e2cd504f626db · chenpangpang / transformers · GitLab

Find file Blame History Permalink

[`Core generation`] Adds support for static KV cache (#27931) · 115ac94d

Arthur authored Feb 08, 2024

Co-authored-by: fxmarty <9808326+fxmarty@users.noreply.github.com>
Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com>
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

115ac94d

test_modeling_llama.py 30.6 KB