Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Repository
74d5543ec589daaa4ac042d65d52dccf26ee3f2c
Switch branch/tag
vllm_cscc
tests
kernels
test_flashinfer.py
Find file
Blame
History
Permalink
[Core][Kernels] Use FlashInfer backend for FP8 KV Cache when available. (#7798)
· b98cc28f
Pavani Majety
authored
Aug 28, 2024
Co-authored-by:
Simon Mo
<
simon.mo@hey.com
>
b98cc28f
test_flashinfer.py
17.9 KB
Edit
Web IDE
Replace test_flashinfer.py
×
Attach a file by drag & drop or
click to upload
Commit message
Replace test_flashinfer.py
Replace file
Cancel
A new branch will be created in your fork and a new merge request will be started.
Simon Mo <simon.mo@hey.com>