Commits · 6e4e1c8cdc987189a0435ea9e6df060df5ea45f2 · change / sglang

27 Aug, 2025 1 commit
- [router] add deepseek tool parser (#9694) · 6e4e1c8c
  Simo Lin authored Aug 27, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  6e4e1c8c
26 Aug, 2025 3 commits
- [router] add token bucket rate limiter (#9656) · 90313fb0
  Chang Su authored Aug 26, 2025
  
  90313fb0
- Fix lint for router (#9636) · cbc0e4d7
  Stefan He authored Aug 26, 2025
  
  cbc0e4d7
- [router] add ut for mistral, llama, pythonic, and streaming tool parser (#9632) · e2e378ca
  Simo Lin authored Aug 25, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  e2e378ca
22 Aug, 2025 2 commits
- [router] Move all protocols to spec.rs file (#9519) · 5ef545e6
  Keyang Ru authored Aug 22, 2025
  
  5ef545e6
- [router] remove all tokenizer metrics for performance (#9474) · 53e2cd46
  Chang Su authored Aug 21, 2025
  
  53e2cd46
21 Aug, 2025 3 commits
- [router] add tokenizer benchmark (#9427) · 78ae1758
  Simo Lin authored Aug 21, 2025
  
  78ae1758
- [router] add tokenizer integration test with real mini tokenizer (#9413) · e6523102
  Chang Su authored Aug 20, 2025
  
  e6523102
- [router] Add IGW (Inference Gateway) Feature Flag (#9371) · 3828db43
  Keyang Ru authored Aug 20, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  3828db43
20 Aug, 2025 2 commits
- [router] Implement OpenAI Responses API specification (#9367) · 5ae5ecaa
  Keyang Ru authored Aug 19, 2025
  
  5ae5ecaa
- [router] add tokenizer chat template support (#9370) · 5fbad308
  Simo Lin authored Aug 19, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  5fbad308
19 Aug, 2025 1 commit
- [router]restructure protocol modules for better organization (#9321) · ce67b2d5
  Keyang Ru authored Aug 18, 2025
  
  ce67b2d5
17 Aug, 2025 1 commit
- [router] add cargo clippy in CI and fix-up linting errors (#9242) · ce3ca9b0
  Jeff Nettleton authored Aug 17, 2025
  
  ce3ca9b0
15 Aug, 2025 1 commit
- [router] allow more health check configuration (#9198) · 21b88460
  Simo Lin authored Aug 15, 2025
  
  21b88460
12 Aug, 2025 1 commit
- [router] Add Rust Binary Entrypoint for SGLang Router (#9089) · 9d68bdb2
  Simo Lin authored Aug 11, 2025
  
  9d68bdb2
11 Aug, 2025 1 commit
- [router] regular router circuit breaker (#8997) · 067068f2
  Simo Lin authored Aug 10, 2025
  
  067068f2
08 Aug, 2025 1 commit
- [router] router circuit breaker core (#8941) · 61a46804
  Simo Lin authored Aug 08, 2025
  
  61a46804
07 Aug, 2025 1 commit
- [router] fix req handling order, improve serialization, remove retry (#8888) · a69b6370
  Simo Lin authored Aug 06, 2025
  
  a69b6370
06 Aug, 2025 2 commits
- [router] PD Router Simplification and Reorganization (#8838) · 8c7bb39d
  Simo Lin authored Aug 05, 2025
  
  8c7bb39d
- [router] complete router oai spec (#8828) · 5d62b56f
  Simo Lin authored Aug 05, 2025
  
  5d62b56f
05 Aug, 2025 1 commit
- [pd-router] Add Configurable Retry Logic for reduce backend pressure (#8744) · 354ac435
  Simo Lin authored Aug 04, 2025
  
  354ac435
03 Aug, 2025 1 commit
- [router] Implement HTTP Dependency Injection Pattern for Router System (#8714) · 828a4fe9
  Simo Lin authored Aug 02, 2025
  
  828a4fe9
31 Jul, 2025 1 commit
- [router] migrate router from actix to axum (#8479) · 66a398f4
  Simo Lin authored Jul 30, 2025
  
  66a398f4
30 Jul, 2025 1 commit
- [feature] [sgl-router] Add a dp-aware routing strategy (#6869) · a730ce81
  Rui Chen authored Jul 30, 2025
  
  a730ce81
28 Jul, 2025 1 commit
- [router] improve router logs and request id header (#8415) · fe6a445d
  Simo Lin authored Jul 27, 2025
  
  fe6a445d
27 Jul, 2025 1 commit
- [router] add different policies for p node and d node (#8395) · 2ab97023
  Simo Lin authored Jul 27, 2025
  
  2ab97023
24 Jul, 2025 4 commits
- [router] add request format unit test (#8300) · 39fe1e88
  Simo Lin authored Jul 24, 2025
  
  39fe1e88
- [router] add streaming unit test (#8299) · 33c4b4d0
  Simo Lin authored Jul 24, 2025
  
  33c4b4d0
- [router] add endpoint unit test (#8298) · 2f86f3ad
  Simo Lin authored Jul 23, 2025
  
  2f86f3ad
- [router] fix pd model completion request (#8303) · f6e07f27
  Simo Lin authored Jul 23, 2025
  
  f6e07f27
23 Jul, 2025 1 commit
- [router] add common ut infra to mock worker and app (#8295) · 6f8f4aee
  Simo Lin authored Jul 23, 2025
  
  6f8f4aee
21 Jul, 2025 1 commit
- [router] add ut for pd router (#8208) · 5c8365a0
  Simo Lin authored Jul 20, 2025
  
  5c8365a0
18 Jul, 2025 1 commit

[router] Refactor router and policy traits with dependency injection (#7987) · c8f31042

Simo Lin authored Jul 18, 2025


Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>

c8f31042

12 Jul, 2025 1 commit
- [router] add worker abstraction (#7960) · f2d5c492
  Simo Lin authored Jul 11, 2025
  
  f2d5c492
08 Jul, 2025 1 commit
- [router] forward stream_options in request (#7860) · 51ae4030
  Shuaiyi Zhang authored Jul 08, 2025
  
  51ae4030
25 Jun, 2025 1 commit
- [ci] add router benchmark script and CI (#7498) · 3abc3036
  Simo Lin authored Jun 25, 2025
  
  3abc3036
23 Jun, 2025 1 commit
- [misc] Add PD service discovery support in router (#7361) · 30f2a44a
  Simo Lin authored Jun 22, 2025
  
  30f2a44a
18 Jun, 2025 1 commit
- Merge PDLB (Prefill-Decode Load Balancer) into SGLang Router (#7096) · 09ae5b20
  Simo Lin authored Jun 18, 2025
  
  09ae5b20