Commits · c3faf2d6e673650b275bbefad9070706efddf3d3 · change / sglang

24 Sep, 2025 1 commit
- [router] select first healthy worker on proxied get requests (#10827) · c3faf2d6
  luna authored Sep 24, 2025
  
  c3faf2d6
23 Sep, 2025 2 commits
- [router] responses api POST and GET with local storage (#10581) · 98c3b04f
  Simo Lin authored Sep 23, 2025
```
Co-authored-by: key4ng <rukeyang@gmail.com>
```
  98c3b04f
- [router] refactor router and worker management 4/n (#10756) · 89971c4c
  Simo Lin authored Sep 22, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  89971c4c
22 Sep, 2025 2 commits
- [router] refactor router and worker management 3/n (#10727) · 97c38239
  Simo Lin authored Sep 22, 2025
  
  97c38239
- bugfix: Fix `get_worker_urls_for_model` in http/router.rs (#10754) · 60dbbd08
  Chang Su authored Sep 22, 2025
  
  60dbbd08
21 Sep, 2025 1 commit
- [Router]fix: fix get_load missing api_key (#10385) · 56321e9f
  Jimmy authored Sep 22, 2025
  
  56321e9f
20 Sep, 2025 1 commit
- [router] refactor router and worker management 2.5/n (#10677) · 1d1ce624
  Simo Lin authored Sep 19, 2025
  
  1d1ce624
19 Sep, 2025 2 commits
- [router] refactor router and worker management 2/n (#10666) · 00eb5eb7
  Simo Lin authored Sep 19, 2025
  
  00eb5eb7
- [router] refactor worker to builder pattern 3/n (#10647) · ac2a723b
  Simo Lin authored Sep 19, 2025
  
  ac2a723b
15 Sep, 2025 2 commits
- [router] fix service discovery and mcp ut (#10449) · 7eccbe99
  Simo Lin authored Sep 15, 2025
  
  7eccbe99
- [router]: Add Embedding routing logic (#10129) · f9ee6ae1
  Jintao Zhang authored Sep 15, 2025
```
Signed-off-by: Jintao Zhang <zhangjintao9020@gmail.com>
Co-authored-by: Waël Boukhobza <wawa_wael@live.fr>
```
  f9ee6ae1
12 Sep, 2025 4 commits
- [router] Add get and cancel method for response api (#10387) · 366043db
  Keyang Ru authored Sep 12, 2025
  
  366043db
- [router] allow one router to support different model families and serving mode (#10244) · 2f173ea0
  Simo Lin authored Sep 12, 2025
  
  2f173ea0
- [router] Add Rerank Routing Logic in Regular Router (#10219) · 4634fd59
  Frank Fang authored Sep 13, 2025
  
  4634fd59
- [router] Basic OAI Response api (#10346) · a23bdeaf
  Keyang Ru authored Sep 11, 2025
  
  a23bdeaf
04 Sep, 2025 1 commit
- [router] clean up dependency injector to use ctx (#10000) · 4f8a982d
  Simo Lin authored Sep 04, 2025
  
  4f8a982d
02 Sep, 2025 1 commit
- [router] Fix short timeout for the prefill client (#9803) · 9d9fa9a5
  LukasBluebaum authored Sep 02, 2025
  
  9d9fa9a5
28 Aug, 2025 1 commit
- [router] grpc router bootstraps (#9759) · 53430588
  Simo Lin authored Aug 28, 2025
  
  53430588
26 Aug, 2025 1 commit
- [router] address worker load tracking consistency (#9523) · 3578eb1e
  Simo Lin authored Aug 26, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  3578eb1e
22 Aug, 2025 1 commit
- [router] Move all protocols to spec.rs file (#9519) · 5ef545e6
  Keyang Ru authored Aug 22, 2025
  
  5ef545e6
19 Aug, 2025 1 commit
- [router]restructure protocol modules for better organization (#9321) · ce67b2d5
  Keyang Ru authored Aug 18, 2025
  
  ce67b2d5
17 Aug, 2025 1 commit
- [router] add cargo clippy in CI and fix-up linting errors (#9242) · ce3ca9b0
  Jeff Nettleton authored Aug 17, 2025
  
  ce3ca9b0
15 Aug, 2025 3 commits
- [router] preserve original worker response header in router (#9236) · da53e13c
  Simo Lin authored Aug 15, 2025
  
  da53e13c
- [router] clean up lint warnings with clippy execution (#9201) · d7e38b2f
  Jeff Nettleton authored Aug 15, 2025
  
  d7e38b2f
- [router] allow more health check configuration (#9198) · 21b88460
  Simo Lin authored Aug 15, 2025
  
  21b88460
12 Aug, 2025 1 commit
- [router] Add Rust Binary Entrypoint for SGLang Router (#9089) · 9d68bdb2
  Simo Lin authored Aug 11, 2025
  
  9d68bdb2
11 Aug, 2025 2 commits
- [pd-router] add retry and circuit breakfor for pd router (#9051) · 6f81a710
  Simo Lin authored Aug 11, 2025
  
  6f81a710
- [router] regular router circuit breaker (#8997) · 067068f2
  Simo Lin authored Aug 10, 2025
  
  067068f2
08 Aug, 2025 2 commits
- [router] harden retries + metrics; fix streaming load; header filtering (#8972) · a59cbea9
  Simo Lin authored Aug 08, 2025
  
  a59cbea9
- [router] router circuit breaker core (#8941) · 61a46804
  Simo Lin authored Aug 08, 2025
  
  61a46804
05 Aug, 2025 1 commit
- [pd-router] Add Configurable Retry Logic for reduce backend pressure (#8744) · 354ac435
  Simo Lin authored Aug 04, 2025
  
  354ac435
03 Aug, 2025 1 commit
- [router] Implement HTTP Dependency Injection Pattern for Router System (#8714) · 828a4fe9
  Simo Lin authored Aug 02, 2025
  
  828a4fe9
31 Jul, 2025 1 commit
- [router] migrate router from actix to axum (#8479) · 66a398f4
  Simo Lin authored Jul 30, 2025
  
  66a398f4
30 Jul, 2025 1 commit
- [feature] [sgl-router] Add a dp-aware routing strategy (#6869) · a730ce81
  Rui Chen authored Jul 30, 2025
  
  a730ce81
28 Jul, 2025 1 commit
- [router] improve router logs and request id header (#8415) · fe6a445d
  Simo Lin authored Jul 27, 2025
  
  fe6a445d
22 Jul, 2025 1 commit
- fix: sgl-router remove dead code (#8257) · c33499a6
  Rui Chen authored Jul 22, 2025
  
  c33499a6
19 Jul, 2025 1 commit
- [router] router metrics cleanup (#8158) · 8fcc55cf
  Simo Lin authored Jul 18, 2025
  
  8fcc55cf
18 Jul, 2025 1 commit

[router] Refactor router and policy traits with dependency injection (#7987) · c8f31042

Simo Lin authored Jul 18, 2025


Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>

c8f31042