vllm/worker/model_runner.py · 300acb83472512b14ec7ba8cdf45efe07e8c8f68 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Core][Bugfix] Use correct device to initialize GPU data during CUDA-graph-capture (#11233) · 300acb83
Yan Burman authored Jan 04, 2025
```
Signed-off-by: Yan Burman <yanburman@users.noreply.github.com>
Signed-off-by: Ido Asraff <idoa@atero.ai>
```
300acb83

model_runner.py 87.4 KB