Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
2adb4409
Unverified
Commit
2adb4409
authored
Oct 28, 2024
by
Yan Ma
Committed by
GitHub
Oct 28, 2024
Browse files
[Bugfix] Fix ray instance detect issue (#9439)
parent
feb92fbe
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
10 additions
and
3 deletions
+10
-3
vllm/executor/ray_utils.py
vllm/executor/ray_utils.py
+10
-3
No files found.
vllm/executor/ray_utils.py
View file @
2adb4409
...
...
@@ -232,6 +232,13 @@ def initialize_ray_cluster(
# Connect to a ray cluster.
if
current_platform
.
is_rocm
()
or
current_platform
.
is_xpu
():
# Try to connect existing ray instance and create a new one if not found
try
:
ray
.
init
(
"auto"
)
except
ConnectionError
:
logger
.
warning
(
"No existing RAY instance detected. "
"A new instance will be launched with current node resources."
)
ray
.
init
(
address
=
ray_address
,
ignore_reinit_error
=
True
,
num_gpus
=
parallel_config
.
world_size
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment