vllm/v1/kv_cache_interface.py · 84c276d7ea00c5bcb6af21b8035d57735479e0ab · OpenDAS / vllm_cscc

[Bugfix] Cap SWA/chunked-local runtime admission to startup pool-sizing bound (#40946) · 84c276d7

Dao007forever authored Apr 26, 2026


Signed-off-by: Dao Le <Dao007forever@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
(cherry picked from commit 7b1bc0a3eb01a6bc2650eda9970049f7825240d7)

84c276d7

kv_cache_interface.py 28.3 KB

Replace kv_cache_interface.py