vllm/utils/flashinfer.py · 2dda3e35d054235b0c2170df359b42ec25b4fe2c · OpenDAS / vllm_cscc

[Spec Decode] Enable FlashInfer Spec Decoding (#25196) · c30b405b

Benjamin Chislett authored Sep 23, 2025


Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: lhsjohn <huashuoli@tencent.com>

c30b405b

flashinfer.py 13.5 KB

Replace flashinfer.py