Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
text-generation-inference
Repository
8ec57558cd5b7b2ad3eaacdd6295a3db0c9092d0
Switch branch/tag
text-generation-inference
server
text_generation_server
layers
attention
cuda.py
Find file
Blame
History
Permalink
Break cycle between the attention implementations and KV cache (#2627)
· 8ec57558
Daniël de Kok
authored
Oct 17, 2024
8ec57558
cuda.py
10.3 KB
Edit
Web IDE
Replace cuda.py
×
Attach a file by drag & drop or
click to upload
Commit message
Replace cuda.py
Replace file
Cancel
A new branch will be created in your fork and a new merge request will be started.
