Commits · 91e2f902db0e4c2d855e6c252de2ff38b92a1cc5 · change / sglang

08 Aug, 2025 3 commits
- [router] harden retries + metrics; fix streaming load; header filtering (#8972) · a59cbea9
  Simo Lin authored Aug 08, 2025
  
  a59cbea9
- [router] router circuit breaker core (#8941) · 61a46804
  Simo Lin authored Aug 08, 2025
  
  61a46804
- [router] dedicated prefill HTTP client and request-path optimizations (#8923) · 2e901e89
  Simo Lin authored Aug 07, 2025
  
  2e901e89
07 Aug, 2025 2 commits
- refactor(sgl-router): Replace `once_cell` with `LazyLock` in worker.rs and... · fd05b567
  Tien Nguyen authored Aug 07, 2025
```
refactor(sgl-router): Replace `once_cell` with `LazyLock` in worker.rs and remove once_cell dependency from Cargo.toml (#8698)
```
  fd05b567
- [router] fix req handling order, improve serialization, remove retry (#8888) · a69b6370
  Simo Lin authored Aug 06, 2025
  
  a69b6370
06 Aug, 2025 2 commits
- [router] PD Router Simplification and Reorganization (#8838) · 8c7bb39d
  Simo Lin authored Aug 05, 2025
  
  8c7bb39d
- [router] complete router oai spec (#8828) · 5d62b56f
  Simo Lin authored Aug 05, 2025
  
  5d62b56f
05 Aug, 2025 1 commit
- [pd-router] Add Configurable Retry Logic for reduce backend pressure (#8744) · 354ac435
  Simo Lin authored Aug 04, 2025
  
  354ac435
04 Aug, 2025 1 commit
- [router] introduce dp worker abstraction (#8639) · 2fa0462c
  Simo Lin authored Aug 04, 2025
  
  2fa0462c
03 Aug, 2025 1 commit
- [router] Implement HTTP Dependency Injection Pattern for Router System (#8714) · 828a4fe9
  Simo Lin authored Aug 02, 2025
  
  828a4fe9
02 Aug, 2025 1 commit
- [router] minor code clean up and and refactoring (#8711) · 6d4fd882
  Simo Lin authored Aug 02, 2025
  
  6d4fd882
01 Aug, 2025 1 commit
- [bug] limit bootstrap room to to [0, 2^63 - 1] (#8684) · ab9b893e
  Simo Lin authored Aug 01, 2025
  
  ab9b893e
31 Jul, 2025 1 commit
- [router] migrate router from actix to axum (#8479) · 66a398f4
  Simo Lin authored Jul 30, 2025
  
  66a398f4
30 Jul, 2025 1 commit
- [feature] [sgl-router] Add a dp-aware routing strategy (#6869) · a730ce81
  Rui Chen authored Jul 30, 2025
  
  a730ce81
28 Jul, 2025 1 commit
- [router] improve router logs and request id header (#8415) · fe6a445d
  Simo Lin authored Jul 27, 2025
  
  fe6a445d
27 Jul, 2025 1 commit
- [router] add different policies for p node and d node (#8395) · 2ab97023
  Simo Lin authored Jul 27, 2025
  
  2ab97023
24 Jul, 2025 1 commit
- [router] fix pd model completion request (#8303) · f6e07f27
  Simo Lin authored Jul 23, 2025
  
  f6e07f27
22 Jul, 2025 1 commit
- fix: sgl-router remove dead code (#8257) · c33499a6
  Rui Chen authored Jul 22, 2025
  
  c33499a6
21 Jul, 2025 1 commit
- [router] add ut for pd router (#8208) · 5c8365a0
  Simo Lin authored Jul 20, 2025
  
  5c8365a0
20 Jul, 2025 1 commit
- [router] add ut for pd request, metrics and config (#8184) · 1fc455e8
  Simo Lin authored Jul 20, 2025
  
  1fc455e8
19 Jul, 2025 3 commits
- [router] add ut for worker and errors (#8170) · 41d33e47
  Simo Lin authored Jul 19, 2025
  
  41d33e47
- Fix suffix mismatch for the metrics. (#8168) · f3d97361
  Charles Chen authored Jul 20, 2025
```
Signed-off-by: Charles Chen <chenliqian@chenliqian.cn>
```
  f3d97361
- [router] router metrics cleanup (#8158) · 8fcc55cf
  Simo Lin authored Jul 18, 2025
  
  8fcc55cf
18 Jul, 2025 1 commit

[router] Refactor router and policy traits with dependency injection (#7987) · c8f31042

Simo Lin authored Jul 18, 2025


Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>

c8f31042

12 Jul, 2025 1 commit
- [router] add worker abstraction (#7960) · f2d5c492
  Simo Lin authored Jul 11, 2025
  
  f2d5c492
10 Jul, 2025 1 commit
- [bugfix] add pd router policy validation (#7904) · 4ed57807
  Simo Lin authored Jul 09, 2025
  
  4ed57807
09 Jul, 2025 1 commit
- [router] Update metrics when request completes (#7899) · 7590f522
  Shuaiyi Zhang authored Jul 09, 2025
  
  7590f522
08 Jul, 2025 1 commit
- [router] forward stream_options in request (#7860) · 51ae4030
  Shuaiyi Zhang authored Jul 08, 2025
  
  51ae4030
07 Jul, 2025 1 commit
- [bugfix] Fix sgl-router get_server_info endpoint compatibility issue (#7813) · ea3e7ffe
  Simo Lin authored Jul 06, 2025
  
  ea3e7ffe
03 Jul, 2025 1 commit
- [router] add --log-level to sgl-router (#6512) · 82f021e2
  Zilin Zhu authored Jul 03, 2025
  
  82f021e2
29 Jun, 2025 2 commits
- [bugfix] fix runtime dropping panic in editable (#7628) · e3f9b548
  Simo Lin authored Jun 29, 2025
  
  e3f9b548
- Fix sgl-router startup crash (#7619) · b3cff365
  finetune authored Jun 29, 2025
  
  b3cff365
27 Jun, 2025 1 commit
- [router] add centralized configuration module for sgl-router (#7588) · c071198c
  Simo Lin authored Jun 27, 2025
  
  c071198c
23 Jun, 2025 1 commit
- [misc] Add PD service discovery support in router (#7361) · 30f2a44a
  Simo Lin authored Jun 22, 2025
  
  30f2a44a
18 Jun, 2025 1 commit
- Merge PDLB (Prefill-Decode Load Balancer) into SGLang Router (#7096) · 09ae5b20
  Simo Lin authored Jun 18, 2025
  
  09ae5b20
02 Jun, 2025 1 commit
- [Router] Fix k8s Service Discovery (#6766) · ff914748
  Arthur Cheng authored Jun 02, 2025
```
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  ff914748
25 May, 2025 1 commit
- Sgl-router Prometheus metrics endpoint and usage track metrics (#6537) · 1a399799
  Chao Yang authored May 24, 2025
  
  1a399799
21 May, 2025 1 commit
- [router] support http2 in router (#6487) · 669caa0a
  Zilin Zhu authored May 21, 2025
  
  669caa0a
17 May, 2025 1 commit
- [router] Add /list_workers endpoint to router (#6366) · e3bed74a
  Zilin Zhu authored May 18, 2025
  
  e3bed74a
11 May, 2025 1 commit
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935