vllm/v1/engine/async_llm.py · 7afe0faab1eb2ab84cda5cab29b24046e516f7b8 · OpenDAS / vllm_cscc

[Frontend][Core] Re-add shutdown timeout - allowing in-flight requests to finish (#36666) · 7afe0faa

Mark McLoughlin authored Mar 13, 2026


Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

7afe0faa

async_llm.py 41.4 KB

Replace async_llm.py