Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
text-generation-inference
e415b690a68d7a0e149c996e46def41c867ff421
e415b690a68d7a0e149c996e46def41c867ff421
Switch branch/tag
text-generation-inference
server
Makefile-flashinfer
Find file
Normal view
History
Permalink
Makefile-flashinfer
95 Bytes
Edit
Web IDE
Newer
Older
Lots of improvements (Still 2 allocators) (#2449)
Nicolas Patry
committed
Aug 29, 2024
1
2
install-flashinfer:
pip install flashinfer==0.1.5 -i https://flashinfer.ai/whl/cu124/torch2.4
