vllm/v1/worker/gpu_model_runner.py · ac0048c0aea977e520aa19f3b9155fc19d696df7 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[BugFix] [DP/EP] Fix slow execution when BS <= DP (#25407) · ac0048c0

Matthew Bonanni authored Sep 22, 2025

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Chris Bamford <chrisbam4d@gmail.com>

ac0048c0

gpu_model_runner.py 184 KB