vllm/worker/model_runner.py · 09d3550372db10f8c75fddd437325a863265fd82 · OpenDAS / vllm_cscc

[Misc] Add logging for CUDA memory (#10027) · 09d35503

Chenghao (Alan) Yang authored Nov 05, 2024


Signed-off-by: Chenghao Yang <yangalan1996@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Chenghao Yang <yangalan1996@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

09d35503

model_runner.py 83.3 KB

Replace model_runner.py