docs/design/hybrid_kv_cache_manager.md · d2b52805f24ba63e3bc7d873f74caa17ac9ff36f · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[doc] Hybrid KV Cache Manager design doc (#22688) · d696f86e

Chen Zhang authored Aug 26, 2025

Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

d696f86e

hybrid_kv_cache_manager.md 15.1 KB