Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
text-generation-inference
d6b0fb9e25f98fabb56e1865e8ba890aa27b4279
d6b0fb9e25f98fabb56e1865e8ba890aa27b4279
Switch branch/tag
text-generation-inference
server
text_generation_server
models
globals.py
Find file
Normal view
History
Permalink
globals.py
56 Bytes
Edit
Web IDE
Newer
Older
Improving mamba runtime by using updates (#1552)
Nicolas Patry
committed
Feb 14, 2024
1
2
3
import
torch
MEM_POOL
=
torch
.
cuda
.
graph_pool_handle
()