Commits · 2f173ea0744d2dca264afb4ad835c8e7dc2eb3b8 · change / sglang

12 Sep, 2025 1 commit
- [router] allow one router to support different model families and serving mode (#10244) · 2f173ea0
  Simo Lin authored Sep 12, 2025
  
  2f173ea0
05 Sep, 2025 1 commit
- Simplify `Router` arguments passing and build it in docker image (#9964) · 6e95f5e5
  Liangsheng Yin authored Sep 05, 2025
  
  6e95f5e5
02 Sep, 2025 1 commit
- [router] add grpc pd and regular router init (#9893) · 9a0cac1b
  Chang Su authored Sep 01, 2025
  
  9a0cac1b
26 Aug, 2025 1 commit
- [router] add token bucket rate limiter (#9656) · 90313fb0
  Chang Su authored Aug 26, 2025
  
  90313fb0
15 Aug, 2025 1 commit
- [router] allow more health check configuration (#9198) · 21b88460
  Simo Lin authored Aug 15, 2025
  
  21b88460
11 Aug, 2025 1 commit
- [router] regular router circuit breaker (#8997) · 067068f2
  Simo Lin authored Aug 10, 2025
  
  067068f2
01 Aug, 2025 1 commit
- [bugfix] fix router python parser for pd urls (#8644) · 2886e23d
  Simo Lin authored Jul 31, 2025
  
  2886e23d
31 Jul, 2025 1 commit
- [router] migrate router from actix to axum (#8479) · 66a398f4
  Simo Lin authored Jul 30, 2025
  
  66a398f4
30 Jul, 2025 1 commit
- [feature] [sgl-router] Add a dp-aware routing strategy (#6869) · a730ce81
  Rui Chen authored Jul 30, 2025
  
  a730ce81
28 Jul, 2025 1 commit
- [router] improve router logs and request id header (#8415) · fe6a445d
  Simo Lin authored Jul 27, 2025
  
  fe6a445d
27 Jul, 2025 1 commit
- [router] add different policies for p node and d node (#8395) · 2ab97023
  Simo Lin authored Jul 27, 2025
  
  2ab97023
19 Jul, 2025 1 commit
- [router] allow router to have empty workers (#8160) · b763cf7e
  Simo Lin authored Jul 18, 2025
  
  b763cf7e
03 Jul, 2025 1 commit
- [router] add --log-level to sgl-router (#6512) · 82f021e2
  Zilin Zhu authored Jul 03, 2025
  
  82f021e2
23 Jun, 2025 1 commit
- [misc] Add PD service discovery support in router (#7361) · 30f2a44a
  Simo Lin authored Jun 22, 2025
  
  30f2a44a
18 Jun, 2025 1 commit
- Merge PDLB (Prefill-Decode Load Balancer) into SGLang Router (#7096) · 09ae5b20
  Simo Lin authored Jun 18, 2025
  
  09ae5b20
25 May, 2025 1 commit
- Sgl-router Prometheus metrics endpoint and usage track metrics (#6537) · 1a399799
  Chao Yang authored May 24, 2025
  
  1a399799
29 Apr, 2025 1 commit
- [Misc] add service discovery for sgl router · 1468769b
  Simo Lin authored Apr 29, 2025
  
  1468769b
27 Apr, 2025 1 commit
- [Misc] add structure logging, write to file and log tracing for SGL Router · f0365820
  Simo Lin authored Apr 27, 2025
  
  f0365820
20 Jan, 2025 2 commits
- [router] Expose worker startup interval (#3019) · 3a8428ec
  Byron Hsu authored Jan 20, 2025
  
  3a8428ec
- [router] Expose worker startup secs & Return error instead of panic for router init (#3016) · 0311ce8e
  Byron Hsu authored Jan 20, 2025
  
  0311ce8e
19 Jan, 2025 1 commit
- [router] Allow empty worker list for sglang.launch_router (#2979) · ef18b0ed
  Byron Hsu authored Jan 19, 2025
  
  ef18b0ed
12 Dec, 2024 2 commits
- Rename rust folder to sgl-router (#2464) · e3b3acfa
  Ata Fatahi authored Dec 12, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  e3b3acfa
- Make request payload size configurable (#2444) · 2ac36b9a
  Ata Fatahi authored Dec 11, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  2ac36b9a
25 Nov, 2024 2 commits
- [router] Replace print with logger (#2183) · 4d62bca5
  Byron Hsu authored Nov 25, 2024
  
  4d62bca5
- Replace prob based with threshold based load balancing (#2170) · 4b0a1c93
  Byron Hsu authored Nov 24, 2024
  
  4b0a1c93
23 Nov, 2024 1 commit
- [router] cache-aware load-balancing router v1 (#2114) · cbedd1db
  Byron Hsu authored Nov 23, 2024
  
  cbedd1db