"docs/features/tool_calling.md" did not exist on "0d115460a718cd35992415829884de0852c14fa3"
Unverified Commit cdeec2e6 authored by Julien Denize's avatar Julien Denize Committed by GitHub
Browse files

[BugFix] Ray with multiple nodes (#28873)


Signed-off-by: default avatarJulien Denize <julien.denize@mistral.ai>
parent 1607e664
......@@ -209,8 +209,8 @@ class Worker(WorkerBase):
torch.cuda.device_count() if torch.cuda.is_available() else 0
)
assert self.parallel_config.local_world_size <= visible_device_count, (
f"local_world_size ({self.parallel_config.local_world_size}) must be "
f"less than or equal to the number of visible devices "
f"local_world_size ({self.parallel_config.local_world_size}) must "
f"be less than or equal to the number of visible devices "
f"({visible_device_count})."
)
self.device = torch.device(f"cuda:{self.local_rank}")
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment