vllm/worker/model_runner.py · 1591c68fdea97a213d5564f687009c4fd1b44608 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Kernel] Use flashinfer for decoding (#4353) · 43c413ec
Lily Liu authored May 03, 2024
```
Co-authored-by: LiuXiaoxuanPKU <llilyliupku@gmail.com>
```
43c413ec

model_runner.py 48.7 KB