"git@developer.sourcefind.cn:OpenDAS/ollama.git" did not exist on "6ecd7f64ba36b1d24ea4bb1b73a6dc4234e7d567"
Unverified Commit 642fa966 authored by Wenyi Xu's avatar Wenyi Xu Committed by GitHub
Browse files

[Docs] [Router]: Update sg-router doc on circuit breaker (#11449)

parent da7fac1b
...@@ -225,6 +225,25 @@ python -m sglang_router.launch_router \ ...@@ -225,6 +225,25 @@ python -m sglang_router.launch_router \
--cb-window-duration-secs 60 --cb-window-duration-secs 60
``` ```
```mermaid
flowchart TD
Closed(["Closed"])
Open(["Open"])
HalfOpen(["HalfOpen"])
Closed -- "Consecutive Failures >=<br/>cb-failure-threshold" --> Open;
Closed --> HalfOpen;
linkStyle 1 stroke:transparent;
Open -- "After cb-timeout-duration-secs" --> HalfOpen;
HalfOpen -- "Fail any test request" --> Open;
HalfOpen -- "After cb-success-threshold<br/>test requests" --> Closed;
Closed -- "Failures < cb-failure-threshold" --> Closed;
style Closed fill:#00C853,color:#000000
style Open fill:#D50000,color:#000000
style HalfOpen fill:#FFD600,color:#000000
linkStyle 1 stroke:transparent,fill:none
```
**Behavior**: **Behavior**:
- Worker is marked unhealthy after `cb-failure-threshold` consecutive failures - Worker is marked unhealthy after `cb-failure-threshold` consecutive failures
- Returns to service after `cb-success-threshold` successful health checks - Returns to service after `cb-success-threshold` successful health checks
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment