Skip to content

GitLab

Unverified Commit 1585244b authored by Hongkuan Zhou's avatar Hongkuan Zhou Committed by GitHub
Browse files

fix: add watchdog timeout for sglang dsr1 recipe (#6076) 


Signed-off-by: default avatarhongkuanz <hongkuanz@nvidia.com>
parent bf270c28
Hide whitespace changes
Inline Side-by-side
Showing with 10 additions and 2 deletions
recipes/deepseek-r1/sglang/disagg-16gpu/deploy.yaml
View file @ 1585244b
...@@ -67,6 +67,8 @@ spec: ...@@ -67,6 +67,8 @@ spec:
- --host - --host
- 0.0.0.0 - 0.0.0.0
- --prefill-round-robin-balance - --prefill-round-robin-balance
- --watchdog-timeout
- "3600"
prefill: prefill:
componentType: worker componentType: worker
subComponentType: prefill subComponentType: prefill
...@@ -109,4 +111,6 @@ spec: ...@@ -109,4 +111,6 @@ spec:
- --host - --host
- 0.0.0.0 - 0.0.0.0
- --load-balance-method - --load-balance-method
- round_robin - round_robin
\ No newline at end of file - --watchdog-timeout
- "3600"
\ No newline at end of file
recipes/deepseek-r1/sglang/disagg-8gpu/deploy.yaml
View file @ 1585244b
...@@ -64,6 +64,8 @@ spec: ...@@ -64,6 +64,8 @@ spec:
- --host - --host
- 0.0.0.0 - 0.0.0.0
- --prefill-round-robin-balance - --prefill-round-robin-balance
- --watchdog-timeout
- "3600"
prefill: prefill:
componentType: worker componentType: worker
subComponentType: prefill subComponentType: prefill
...@@ -103,4 +105,6 @@ spec: ...@@ -103,4 +105,6 @@ spec:
- --host - --host
- 0.0.0.0 - 0.0.0.0
- --load-balance-method - --load-balance-method
- round_robin - round_robin
\ No newline at end of file - --watchdog-timeout
- "3600"
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment