Skip to content

GitLab

Unverified Commit 27f7bed7 authored by Byron Hsu's avatar Byron Hsu Committed by GitHub
Browse files

reduce watchdog interval to 5s (#2410)

parent 6387098f
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/managers/tokenizer_manager.py
View file @ 27f7bed7
...@@ -572,7 +572,7 @@ class TokenizerManager: ...@@ -572,7 +572,7 @@ class TokenizerManager:
async def sigterm_watchdog(self): async def sigterm_watchdog(self):
while not self.gracefully_exit: while not self.gracefully_exit:
await asyncio.sleep(60) await asyncio.sleep(5)
# drain requests # drain requests
while True: while True:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment