Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
61b1d2f6
Unverified
Commit
61b1d2f6
authored
Dec 11, 2024
by
Russell Bryant
Committed by
GitHub
Dec 11, 2024
Browse files
[Core] v1: Use atexit to handle engine core client shutdown (#11076)
Signed-off-by:
Russell Bryant
<
rbryant@redhat.com
>
parent
9974fca0
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
0 deletions
+2
-0
vllm/v1/engine/core_client.py
vllm/v1/engine/core_client.py
+2
-0
No files found.
vllm/v1/engine/core_client.py
View file @
61b1d2f6
import
atexit
import
multiprocessing
from
typing
import
List
,
Union
...
...
@@ -157,6 +158,7 @@ class MPClient(EngineCoreClient):
should_shutdown
=
self
.
should_shutdown
,
**
kwargs
,
)
atexit
.
register
(
self
.
shutdown
)
def
shutdown
(
self
):
# Send shutdown signal to background process.
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment