Commits · 2f173ea0744d2dca264afb4ad835c8e7dc2eb3b8 · change / sglang · GitLab

12 Sep, 2025 2 commits
- [router] allow one router to support different model families and serving mode (#10244) · 2f173ea0
  Simo Lin authored Sep 12, 2025
  
  2f173ea0
- [router][ci] Add gpu utilization analyze with nvml (#10345) · 7b141f81
  Keyang Ru authored Sep 11, 2025
  
  7b141f81
11 Sep, 2025 1 commit
- [router] add benchmark for regular router and pd router (#10280) · 480d1b8b
  Keyang Ru authored Sep 11, 2025
  
  480d1b8b
10 Sep, 2025 1 commit
- [router] Add PD router mmlu test (#10256) · cda7e47c
  Keyang Ru authored Sep 10, 2025
  
  cda7e47c
06 Sep, 2025 2 commits
- [router] Improve the router e2e tests (#10102) · 9eb50ecc
  Keyang Ru authored Sep 06, 2025
  
  9eb50ecc
- [router] Introduce router integration tests (#10086) · 21b9a4b4
  Keyang Ru authored Sep 05, 2025
  
  21b9a4b4
05 Sep, 2025 2 commits
- [router] add py binding unit tests to coverage 80% (#10043) · 045ab92d
  Keyang Ru authored Sep 05, 2025
  
  045ab92d
- Simplify `Router` arguments passing and build it in docker image (#9964) · 6e95f5e5
  Liangsheng Yin authored Sep 05, 2025
  
  6e95f5e5
02 Sep, 2025 1 commit
- [router] add grpc pd and regular router init (#9893) · 9a0cac1b
  Chang Su authored Sep 01, 2025
  
  9a0cac1b
12 Aug, 2025 1 commit
- [CI] migrate router to BM.A10.4 runner (#8992) · 4093d460
  Keyang Ru authored Aug 11, 2025
```
Co-authored-by: key4ng <rukeyang@gamil.com>
```
  4093d460
11 Aug, 2025 1 commit
- [router] regular router circuit breaker (#8997) · 067068f2
  Simo Lin authored Aug 10, 2025
  
  067068f2
31 Jul, 2025 2 commits
- Fix typos in py_test/test_launch_server.py (#6227) · 061c8959
  Michael Yao authored Aug 01, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  061c8959
- [router] migrate router from actix to axum (#8479) · 66a398f4
  Simo Lin authored Jul 30, 2025
  
  66a398f4
30 Jul, 2025 1 commit
- [feature] [sgl-router] Add a dp-aware routing strategy (#6869) · a730ce81
  Rui Chen authored Jul 30, 2025
  
  a730ce81
19 Jul, 2025 1 commit
- [router] allow router to have empty workers (#8160) · b763cf7e
  Simo Lin authored Jul 18, 2025
  
  b763cf7e
18 Jul, 2025 1 commit

[router] Refactor router and policy traits with dependency injection (#7987) · c8f31042

Simo Lin authored Jul 18, 2025


Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>

c8f31042

03 Jul, 2025 1 commit
- [router] add --log-level to sgl-router (#6512) · 82f021e2
  Zilin Zhu authored Jul 03, 2025
  
  82f021e2
23 Jun, 2025 1 commit
- [misc] Add PD service discovery support in router (#7361) · 30f2a44a
  Simo Lin authored Jun 22, 2025
  
  30f2a44a
18 Jun, 2025 1 commit
- Merge PDLB (Prefill-Decode Load Balancer) into SGLang Router (#7096) · 09ae5b20
  Simo Lin authored Jun 18, 2025
  
  09ae5b20
25 May, 2025 1 commit
- Sgl-router Prometheus metrics endpoint and usage track metrics (#6537) · 1a399799
  Chao Yang authored May 24, 2025
  
  1a399799
11 May, 2025 1 commit
- Replace time.time() to time.perf_counter() for benchmarking. (#6178) · 6e2da515
  Lifu Huang authored May 11, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  6e2da515
29 Apr, 2025 1 commit
- [Misc] add service discovery for sgl router · 1468769b
  Simo Lin authored Apr 29, 2025
  
  1468769b
27 Apr, 2025 1 commit
- [Misc] add structure logging, write to file and log tracing for SGL Router · f0365820
  Simo Lin authored Apr 27, 2025
  
  f0365820
17 Mar, 2025 1 commit
- Fix router test (#4483) · 8cc300f5
  Byron Hsu authored Mar 16, 2025
  
  8cc300f5
24 Jan, 2025 1 commit
- [router] Forward all request headers from router to workers (#3070) · 9a0cc2e9
  Byron Hsu authored Jan 23, 2025
  
  9a0cc2e9
20 Jan, 2025 2 commits
- [router] Expose worker startup interval (#3019) · 3a8428ec
  Byron Hsu authored Jan 20, 2025
  
  3a8428ec
- [router] Expose worker startup secs & Return error instead of panic for router init (#3016) · 0311ce8e
  Byron Hsu authored Jan 20, 2025
  
  0311ce8e
19 Jan, 2025 1 commit
- [router] Allow empty worker list for sglang.launch_router (#2979) · ef18b0ed
  Byron Hsu authored Jan 19, 2025
  
  ef18b0ed
12 Dec, 2024 1 commit
- Rename rust folder to sgl-router (#2464) · e3b3acfa
  Ata Fatahi authored Dec 12, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  e3b3acfa