Skip to content

GitLab

Unverified Commit 9ba28043 authored by Rui Qiao's avatar Rui Qiao Committed by GitHub
Browse files

[misc] Show driver IP info when Ray fails to allocate driver worker (#13858) 


Signed-off-by: default avatarRui Qiao <ruisearch42@gmail.com>
parent 24679788
Show whitespace changes
Inline Side-by-side
Showing with 4 additions and 3 deletions
vllm/executor/ray_distributed_executor.py
View file @ 9ba28043
...@@ -229,9 +229,10 @@ class RayDistributedExecutor(DistributedExecutorBase): ...@@ -229,9 +229,10 @@ class RayDistributedExecutor(DistributedExecutorBase):
logger.debug("driver_dummy_worker: %s", self.driver_dummy_worker) logger.debug("driver_dummy_worker: %s", self.driver_dummy_worker)
if not self.use_ray_spmd_worker and self.driver_dummy_worker is None: if not self.use_ray_spmd_worker and self.driver_dummy_worker is None:
raise ValueError( raise ValueError(
"Ray does not allocate any GPUs on the driver node. Consider " "Ray does not allocate any GPUs on the driver node."
"adjusting the Ray placement group or running the driver on a " f"Driver IP: {driver_ip}, worker IPs: {worker_ips}."
"GPU node.") "Consider adjusting the Ray placement group or running "
"the driver on a GPU node.")
ip_counts: Dict[str, int] = {} ip_counts: Dict[str, int] = {}
for ip in worker_ips: for ip in worker_ips:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment