vllm/v1/engine/async_llm.py · 89a385d79fb511f439f8ebe9d38d6811b5b24a91 · OpenDAS / vllm_cscc

[Feat][RL] Pause and Resume with keep requests for single engine (#32351) · 89a385d7

Aaron Hao authored Feb 06, 2026


Signed-off-by: ahao-anyscale <ahao@anyscale.com>
Signed-off-by: Aaron Hao <ahao@anyscale.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

89a385d7

async_llm.py 41.9 KB

Replace async_llm.py