vllm/v1/worker/gpu_model_runner.py · 408e5600158bfa34306cfbd034a3779e488752fa · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Core][Bugfix] Use correct device to initialize GPU data during CUDA-graph-capture (#11233) · 300acb83
Yan Burman authored Jan 04, 2025
```
Signed-off-by: Yan Burman <yanburman@users.noreply.github.com>
Signed-off-by: Ido Asraff <idoa@atero.ai>
```
300acb83

gpu_model_runner.py 39.3 KB