Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
text-generation-inference
a4e3e8c608d1e75b85e849cce931be551bb859ad
a4e3e8c608d1e75b85e849cce931be551bb859ad
Switch branch/tag
text-generation-inference
server
Makefile-flashinfer
Find file
Normal view
History
Permalink
Makefile-flashinfer
95 Bytes
Edit
Web IDE
Newer
Older
Lots of improvements (Still 2 allocators) (#2449)
Nicolas Patry
committed
Aug 29, 2024
1
install-flashinfer:
Prefix test - Different kind of load test to trigger prefix test bugs. (#2490)
Nicolas Patry
committed
Sep 11, 2024
2
pip install flashinfer==0.1.6 -i https://flashinfer.ai/whl/cu124/torch2.4