vllm/v1/executor/uniproc_executor.py · 87a0c076afafb93dd082ff3876bea08adca56c56 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[V1] Move more control of kv cache initialization from model_executor to EngineCore (#11960) · 69d765f5
Chen Zhang authored Jan 17, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
69d765f5

uniproc_executor.py 3.01 KB