vllm/v1/worker/gpu_worker.py · abad204be6eaaae3630db4287ebdca004197f819 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[BugFix] Fix OOM in vLLM replicas by ensuring consistent NCCL memory accounting (#25359) · abad204b
kourosh hakhamaneshi authored Sep 23, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
abad204b

gpu_worker.py 31.6 KB