Commits · 9d68bdb240a5ba2713bd130f96e457f29fc7fba1 · change / sglang

12 Aug, 2025 1 commit
- [router] Add Rust Binary Entrypoint for SGLang Router (#9089) · 9d68bdb2
  Simo Lin authored Aug 11, 2025
  
  9d68bdb2
11 Aug, 2025 3 commits
- refactor(pd-router): extract common patterns to reduce code duplication (#9081) · 38907fe6
  Simo Lin authored Aug 11, 2025
  
  38907fe6
- [pd-router] add retry and circuit breakfor for pd router (#9051) · 6f81a710
  Simo Lin authored Aug 11, 2025
  
  6f81a710
- [router] regular router circuit breaker (#8997) · 067068f2
  Simo Lin authored Aug 10, 2025
  
  067068f2
08 Aug, 2025 3 commits
- [router] fix radix tree integration issues in PD router (#8982) · 7b7e5615
  Simo Lin authored Aug 08, 2025
  
  7b7e5615
- [router] router circuit breaker core (#8941) · 61a46804
  Simo Lin authored Aug 08, 2025
  
  61a46804
- [router] dedicated prefill HTTP client and request-path optimizations (#8923) · 2e901e89
  Simo Lin authored Aug 07, 2025
  
  2e901e89
07 Aug, 2025 1 commit
- [router] fix req handling order, improve serialization, remove retry (#8888) · a69b6370
  Simo Lin authored Aug 06, 2025
  
  a69b6370
06 Aug, 2025 1 commit
- [router] PD Router Simplification and Reorganization (#8838) · 8c7bb39d
  Simo Lin authored Aug 05, 2025
  
  8c7bb39d
05 Aug, 2025 1 commit
- [pd-router] Add Configurable Retry Logic for reduce backend pressure (#8744) · 354ac435
  Simo Lin authored Aug 04, 2025
  
  354ac435
03 Aug, 2025 1 commit
- [router] Implement HTTP Dependency Injection Pattern for Router System (#8714) · 828a4fe9
  Simo Lin authored Aug 02, 2025
  
  828a4fe9
02 Aug, 2025 1 commit
- [router] minor code clean up and and refactoring (#8711) · 6d4fd882
  Simo Lin authored Aug 02, 2025
  
  6d4fd882
31 Jul, 2025 1 commit
- [router] migrate router from actix to axum (#8479) · 66a398f4
  Simo Lin authored Jul 30, 2025
  
  66a398f4
28 Jul, 2025 1 commit
- [router] improve router logs and request id header (#8415) · fe6a445d
  Simo Lin authored Jul 27, 2025
  
  fe6a445d
27 Jul, 2025 1 commit
- [router] add different policies for p node and d node (#8395) · 2ab97023
  Simo Lin authored Jul 27, 2025
  
  2ab97023
24 Jul, 2025 1 commit
- [router] fix pd model completion request (#8303) · f6e07f27
  Simo Lin authored Jul 23, 2025
  
  f6e07f27
21 Jul, 2025 1 commit
- [router] add ut for pd router (#8208) · 5c8365a0
  Simo Lin authored Jul 20, 2025
  
  5c8365a0
19 Jul, 2025 1 commit
- [router] router metrics cleanup (#8158) · 8fcc55cf
  Simo Lin authored Jul 18, 2025
  
  8fcc55cf
18 Jul, 2025 1 commit

[router] Refactor router and policy traits with dependency injection (#7987) · c8f31042

Simo Lin authored Jul 18, 2025


Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>

c8f31042

12 Jul, 2025 1 commit
- [router] add worker abstraction (#7960) · f2d5c492
  Simo Lin authored Jul 11, 2025
  
  f2d5c492
07 Jul, 2025 1 commit
- [bugfix] Fix sgl-router get_server_info endpoint compatibility issue (#7813) · ea3e7ffe
  Simo Lin authored Jul 06, 2025
  
  ea3e7ffe
23 Jun, 2025 1 commit
- [misc] Add PD service discovery support in router (#7361) · 30f2a44a
  Simo Lin authored Jun 22, 2025
  
  30f2a44a
18 Jun, 2025 1 commit
- Merge PDLB (Prefill-Decode Load Balancer) into SGLang Router (#7096) · 09ae5b20
  Simo Lin authored Jun 18, 2025
  
  09ae5b20