vllm/worker/model_runner.py · 064cac7bb7251862a841d8057d83581350edf837 · OpenDAS / vllm_cscc · GitLab

"requirements/neuron.txt" did not exist on "6a6119554cee13bb4ef5018155be5530d6aaca26"

Find file Blame History Permalink

Allow users to specify kv cache memory size (#21489) · 94e6b2d5

Boyuan Feng authored Sep 11, 2025

Signed-off-by: Boyuan Feng <boyuan@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

94e6b2d5

model_runner.py 87.8 KB