vllm/v1/worker/gpu/model_runner.py · 5dc3538736e40428d388f6980025340f4f7524af · OpenDAS / vllm_cscc

[Model Runner V2] support dp & ep for spec decoding (#35294) · 97286a20

zhrrr authored Mar 04, 2026


Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Co-authored-by: Giancarlo Delfin <gdelfin@inferact.ai>

97286a20

model_runner.py 47.2 KB

Replace model_runner.py