Skip to content

GitLab

Unverified Commit c9791f18 authored by Nick Hill's avatar Nick Hill Committed by GitHub
Browse files

[BugFix] Fix broken import in initialize_ray_cluster() (#27838) 


Signed-off-by: default avatarNick Hill <nhill@redhat.com>
parent e7acb200
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/v1/executor/ray_utils.py
View file @ c9791f18
...@@ -322,7 +322,7 @@ def initialize_ray_cluster( ...@@ -322,7 +322,7 @@ def initialize_ray_cluster(
# Prevalidate GPU requirements before Ray processing # Prevalidate GPU requirements before Ray processing
if current_platform.is_cuda() and parallel_config.world_size > 1: if current_platform.is_cuda() and parallel_config.world_size > 1:
from vllm.utils import cuda_device_count_stateless from vllm.utils.torch_utils import cuda_device_count_stateless
available_gpus = cuda_device_count_stateless() available_gpus = cuda_device_count_stateless()
if parallel_config.world_size > available_gpus: if parallel_config.world_size > available_gpus:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment