Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
9f3bc0f5
Unverified
Commit
9f3bc0f5
authored
Mar 07, 2025
by
Cody Yu
Committed by
GitHub
Mar 07, 2025
Browse files
[MISC][V1] Register process killing handler only in the main thread (#14380)
Signed-off-by:
Cody Yu
<
hao.yu.cody@gmail.com
>
parent
980385f8
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
9 additions
and
1 deletion
+9
-1
vllm/v1/engine/core_client.py
vllm/v1/engine/core_client.py
+9
-1
No files found.
vllm/v1/engine/core_client.py
View file @
9f3bc0f5
...
...
@@ -4,6 +4,7 @@ import asyncio
import
os
import
queue
import
signal
import
threading
import
uuid
import
weakref
from
abc
import
ABC
,
abstractmethod
...
...
@@ -260,7 +261,14 @@ class MPClient(EngineCoreClient):
"down. See stack trace above for root cause issue."
)
kill_process_tree
(
os
.
getpid
())
signal
.
signal
(
signal
.
SIGUSR1
,
sigusr1_handler
)
if
threading
.
current_thread
()
==
threading
.
main_thread
():
signal
.
signal
(
signal
.
SIGUSR1
,
sigusr1_handler
)
else
:
logger
.
warning
(
"SIGUSR1 handler not installed because we are not "
"running in the main thread. In this case the "
"forked engine process may not be killed when "
"an exception is raised, and you need to handle "
"the engine process shutdown manually."
)
# Serialization setup.
self
.
encoder
=
MsgpackEncoder
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment