vllm/v1/worker/gpu_model_runner.py · 1c63a16b653d1f3f4260e862f01eaffed283c4c8 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Core] Run garbage collector after CUDA graph capture to fix throughput regression (#24128) · 1c63a16b
Micah Williamson authored Sep 09, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
1c63a16b

gpu_model_runner.py 160 KB