Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
2e02311a
Unverified
Commit
2e02311a
authored
Jun 12, 2024
by
Junichi Sato
Committed by
GitHub
Jun 11, 2024
Browse files
[Bugfix] Fix `MultiprocessingGPUExecutor.check_health` when world_size == 1 (#5254)
parent
89ec06c3
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
1 deletion
+3
-1
vllm/executor/multiproc_gpu_executor.py
vllm/executor/multiproc_gpu_executor.py
+3
-1
No files found.
vllm/executor/multiproc_gpu_executor.py
View file @
2e02311a
...
...
@@ -46,6 +46,7 @@ class MultiprocessingGPUExecutor(DistributedGPUExecutor):
if
world_size
==
1
:
self
.
workers
=
[]
self
.
worker_monitor
=
None
else
:
result_handler
=
ResultHandler
()
self
.
workers
=
[
...
...
@@ -127,7 +128,8 @@ class MultiprocessingGPUExecutor(DistributedGPUExecutor):
def
check_health
(
self
)
->
None
:
"""Raises an error if engine is unhealthy."""
if
not
self
.
worker_monitor
.
is_alive
():
if
self
.
worker_monitor
is
not
None
and
not
self
.
worker_monitor
.
is_alive
(
):
raise
RuntimeError
(
"Worker processes are not running"
)
def
_wait_for_tasks_completion
(
self
,
parallel_worker_tasks
:
Any
)
->
None
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment