vllm/v1/kv_cache_interface.py · 69d765f5a5bbbe1ea9843be19b9480660fc5bc8b · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1] Move more control of kv cache initialization from model_executor to EngineCore (#11960) · 69d765f5
Chen Zhang authored Jan 17, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
69d765f5

kv_cache_interface.py 3.29 KB