vllm/utils.py · ad4a9dc817f00c266d1ca210342d1865aa69db27 · OpenDAS / vllm_cscc

[cuda] manually import the correct pynvml module (#12679) · ad4a9dc8

youkaichao authored Feb 03, 2025

fixes problems like https://github.com/vllm-project/vllm/pull/12635 and
https://github.com/vllm-project/vllm/pull/12636 and
https://github.com/vllm-project/vllm/pull/12565



---------
Signed-off-by: youkaichao <youkaichao@gmail.com>

ad4a9dc8

utils.py 73.8 KB

Replace utils.py