vllm/attention/backends/flashinfer.py · 0c9a5258f905ff3b03019f9134914ab90dbdac01 · OpenDAS / vllm_cscc

[Kernel] Add env variable to force flashinfer backend to enable tensor cores (#9497) · 0c9a5258

Thomas Parnell authored Oct 19, 2024


Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Chih-Chieh Yang <chih.chieh.yang@ibm.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

0c9a5258

flashinfer.py 36.9 KB

Replace flashinfer.py