Skip to content

GitLab

Unverified Commit 93ecb813 authored by Nick Hill's avatar Nick Hill Committed by GitHub
Browse files

[BugFix] Increase TP execute_model timeout (#18558) 


Signed-off-by: default avatarNick Hill <nhill@redhat.com>
parent fae453f8
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/v1/executor/multiproc_executor.py
View file @ 93ecb813
...@@ -38,7 +38,7 @@ logger = init_logger(__name__) ...@@ -38,7 +38,7 @@ logger = init_logger(__name__)
POLLING_TIMEOUT_MS = 5000 POLLING_TIMEOUT_MS = 5000
POLLING_TIMEOUT_S = POLLING_TIMEOUT_MS // 1000 POLLING_TIMEOUT_S = POLLING_TIMEOUT_MS // 1000
EXECUTE_MODEL_TIMEOUT_S = 40 EXECUTE_MODEL_TIMEOUT_S = 300
class MultiprocExecutor(Executor): class MultiprocExecutor(Executor):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment