vllm/v1/worker/cpu_model_runner.py · 1cd6eaba54a2461bcdca3958e5befd9c40907657 · OpenDAS / vllm_cscc

Support encoder-only models without KV-Cache (#21270) · 1cd6eaba

Maximilien de Bayser authored Jul 26, 2025


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

1cd6eaba

cpu_model_runner.py 3.39 KB

Replace cpu_model_runner.py