vllm/v1/worker/gpu_model_runner.py · 38d8096760cd8f42fb65fc0ba2b9fb11f98d8ac3 · OpenDAS / vllm_cscc · GitLab

"vllm/vscode:/vscode.git/clone" did not exist on "e11e2007368b22fce05b9ecdf00dd48eda471f9e"

Find file Blame History Permalink

Allow users to specify kv cache memory size (#21489) · 94e6b2d5

Boyuan Feng authored Sep 11, 2025

Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

94e6b2d5

gpu_model_runner.py 169 KB