vllm/config/vllm.py · d017bceb08eaac7bae2c499124ece737fb4fb22b · OpenDAS / vllm_cscc

[Bugfix] Fix cuda graph sizes when running with speculative decoding (#30330) · 4c2e10ea

PatrykSaffer authored Dec 10, 2025


Signed-off-by: Patryk Saffer <patryk.saffer99@gmail.com>
Signed-off-by: PatrykSaffer <patryk.saffer@mistral.ai>
Co-authored-by: Patryk Saffer <patryk.saffer99@gmail.com>

4c2e10ea

vllm.py 60 KB

Replace vllm.py