Skip to content

GitLab

Commit 3d087876 authored by zhuwenwen's avatar zhuwenwen
Browse files

The timeout for each iteration in the engine is set to 120 seconds by default

parent c7e7ca7b
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/envs.py
View file @ 3d087876
...@@ -144,7 +144,7 @@ environment_variables: Dict[str, Callable[[], Any]] = { ...@@ -144,7 +144,7 @@ environment_variables: Dict[str, Callable[[], Any]] = {
# timeout for each iteration in the engine # timeout for each iteration in the engine
"VLLM_ENGINE_ITERATION_TIMEOUT_S": "VLLM_ENGINE_ITERATION_TIMEOUT_S":
lambda: int(os.environ.get("VLLM_ENGINE_ITERATION_TIMEOUT_S", "60")), lambda: int(os.environ.get("VLLM_ENGINE_ITERATION_TIMEOUT_S", "120")),
# API key for VLLM API server # API key for VLLM API server
"VLLM_API_KEY": "VLLM_API_KEY":
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment