Commit fa3ffb43 authored by Julien Denize's avatar Julien Denize Committed by Kevin H. Luu
Browse files

[BugFix] Ray with multiple nodes (#28873)


Signed-off-by: default avatarJulien Denize <julien.denize@mistral.ai>
(cherry picked from commit cdeec2e6)
parent 6d597436
......@@ -208,8 +208,8 @@ class Worker(WorkerBase):
torch.cuda.device_count() if torch.cuda.is_available() else 0
)
assert self.parallel_config.local_world_size <= visible_device_count, (
f"local_world_size ({self.parallel_config.local_world_size}) must be "
f"less than or equal to the number of visible devices "
f"local_world_size ({self.parallel_config.local_world_size}) must "
f"be less than or equal to the number of visible devices "
f"({visible_device_count})."
)
self.device = torch.device(f"cuda:{self.local_rank}")
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment