Commits · ddab4fc7c70dd6fa1154b0e5d39255078fbbbad6 · change / sglang

23 Sep, 2025 1 commit
- [router] fix cache aware routing strategy and lock contention (#10773) · ddab4fc7
  Simo Lin authored Sep 23, 2025
  
  ddab4fc7
21 Sep, 2025 1 commit
- [Router]fix: fix get_load missing api_key (#10385) · 56321e9f
  Jimmy authored Sep 22, 2025
  
  56321e9f
20 Sep, 2025 1 commit
- [router] refactor router and worker management 2.5/n (#10677) · 1d1ce624
  Simo Lin authored Sep 19, 2025
  
  1d1ce624
19 Sep, 2025 1 commit
- [router] refactor worker to builder pattern 3/n (#10647) · ac2a723b
  Simo Lin authored Sep 19, 2025
  
  ac2a723b
12 Sep, 2025 1 commit
- [router] allow one router to support different model families and serving mode (#10244) · 2f173ea0
  Simo Lin authored Sep 12, 2025
  
  2f173ea0
17 Aug, 2025 1 commit
- [router] add cargo clippy in CI and fix-up linting errors (#9242) · ce3ca9b0
  Jeff Nettleton authored Aug 17, 2025
  
  ce3ca9b0
11 Aug, 2025 1 commit
- [router] regular router circuit breaker (#8997) · 067068f2
  Simo Lin authored Aug 10, 2025
  
  067068f2
10 Aug, 2025 1 commit
- [router] upgrade rand to latest version (#9017) · dd665f96
  Simo Lin authored Aug 09, 2025
  
  dd665f96
08 Aug, 2025 2 commits
- [router] fix radix tree integration issues in PD router (#8982) · 7b7e5615
  Simo Lin authored Aug 08, 2025
  
  7b7e5615
- [router] add metrics for worker and policy (#8971) · 36bfddec
  Tony Lu authored Aug 09, 2025
```
Signed-off-by: Tony Lu <tonyluj@gmail.com>
```
  36bfddec
07 Aug, 2025 1 commit
- [router] fix req handling order, improve serialization, remove retry (#8888) · a69b6370
  Simo Lin authored Aug 06, 2025
  
  a69b6370
28 Jul, 2025 1 commit
- [router] improve router logs and request id header (#8415) · fe6a445d
  Simo Lin authored Jul 27, 2025
  
  fe6a445d
27 Jul, 2025 1 commit
- [router] add different policies for p node and d node (#8395) · 2ab97023
  Simo Lin authored Jul 27, 2025
  
  2ab97023
19 Jul, 2025 1 commit
- [router] router metrics cleanup (#8158) · 8fcc55cf
  Simo Lin authored Jul 18, 2025
  
  8fcc55cf
18 Jul, 2025 1 commit

[router] Refactor router and policy traits with dependency injection (#7987) · c8f31042

Simo Lin authored Jul 18, 2025


Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>

c8f31042