vllm/v1/worker/gpu_model_runner.py · 537d5ee0251bcfcedbb8ca934d273366e05f80fa · OpenDAS / vllm_cscc

[V1][Spec Decode] EAGLE-3 Support (#16937) · a0e619e6

Benjamin Chislett authored Apr 25, 2025


Signed-off-by: Bryan Lu <yuzhelu@amazon.com>
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Co-authored-by: Bryan Lu <yuzhelu@amazon.com>

a0e619e6

gpu_model_runner.py 81 KB

Replace gpu_model_runner.py