vllm/v1/worker/gpu_model_runner.py · 0ff902f3b48376aadfe4e753ce0872b49c8f9f7e · OpenDAS / vllm_cscc

[Refactor] Refactor persistent buffers with CpuGpuBuffer (#23515) · 0ff902f3

Woosuk Kwon authored Aug 25, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

0ff902f3

gpu_model_runner.py 147 KB

Replace gpu_model_runner.py