vllm/v1/kv_cache_interface.py · 9a9fda1423c96aa8ea62a56e8f1ad88fc080ae2c · OpenDAS / vllm_cscc

[Core] Support Local Chunked Attention for Hybrid KV Cache (#19351) · 9a9fda14

Lucia Fang authored Jul 19, 2025


Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lu Fang <fanglu@meta.com>

9a9fda14

kv_cache_interface.py 8.75 KB

Replace kv_cache_interface.py