Commits · e321c9711306e35dc8cf905830ebe5b810ff1bc1 · change / sglang · GitLab

19 Oct, 2025 1 commit
- [router] Add Configurable L0 and L1 Tokenizer Caching (#11688) · a7ae61ed
  Simo Lin authored Oct 18, 2025
  
  a7ae61ed
14 Oct, 2025 1 commit
- [router] add py binding and readme for openai router and history backend (#11453) · eb8cac6f
  Keyang Ru authored Oct 14, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  eb8cac6f
13 Oct, 2025 1 commit
- [router] allow user to specify chat template path (#11549) · 728af887
  Simo Lin authored Oct 13, 2025
  
  728af887
11 Oct, 2025 1 commit
- [router] disable rate limiter by default (#11435) · 2eeb2751
  Simo Lin authored Oct 10, 2025
  
  2eeb2751
07 Oct, 2025 1 commit
- [router] add reasoning and tool parser argument in router (#11290) · 79d34951
  Simo Lin authored Oct 07, 2025
  
  79d34951
06 Oct, 2025 1 commit
- [router] add ipv6 support across all components (#11219) · 5ee777c9
  Simo Lin authored Oct 06, 2025
  
  5ee777c9
26 Sep, 2025 1 commit
- [router] remove old/oudated/useless comments (#10967) · a7fe6e10
  Simo Lin authored Sep 26, 2025
  
  a7fe6e10
25 Sep, 2025 2 commits
- refactor: Move `grpc/client.rs` to `grpc_client/sglang_scheduler.rs` (#10924) · 5e21d6ae
  Chang Su authored Sep 25, 2025
  
  5e21d6ae
- [router] Support Oracle DB(ATP) Data Connector (#10845) · a73eb8cd
  Keyang Ru authored Sep 24, 2025
  
  a73eb8cd
16 Sep, 2025 1 commit
- [router] add router db connector for responses api (#10487) · 16e93359
  Simo Lin authored Sep 16, 2025
  
  16e93359
04 Sep, 2025 1 commit
- [router] fix grpc connection mode detection (#9999) · bbf261ae
  Simo Lin authored Sep 04, 2025
  
  bbf261ae
02 Sep, 2025 1 commit
- [router] add grpc pd and regular router init (#9893) · 9a0cac1b
  Chang Su authored Sep 01, 2025
  
  9a0cac1b
28 Aug, 2025 1 commit
- [router] Add MCP Tool Handler (#9615) · 3f2d0cef
  Keyang Ru authored Aug 27, 2025
  
  3f2d0cef
26 Aug, 2025 1 commit
- [router] add token bucket rate limiter (#9656) · 90313fb0
  Chang Su authored Aug 26, 2025
  
  90313fb0
22 Aug, 2025 1 commit
- [router] add tool parser base structure and partial json parser (#9482) · 816c4c85
  Chang Su authored Aug 21, 2025
  
  816c4c85
21 Aug, 2025 1 commit
- [router] Add IGW (Inference Gateway) Feature Flag (#9371) · 3828db43
  Keyang Ru authored Aug 20, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  3828db43
19 Aug, 2025 2 commits
- [router] Implement gRPC SGLangSchedulerClient (#9364) · 7638f5e4
  Chang Su authored Aug 19, 2025
  
  7638f5e4
- [router]restructure protocol modules for better organization (#9321) · ce67b2d5
  Keyang Ru authored Aug 18, 2025
  
  ce67b2d5
18 Aug, 2025 1 commit
- [router] add reasoning parser base structure (#9310) · 6e316588
  Simo Lin authored Aug 18, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  6e316588
17 Aug, 2025 2 commits
- [router] introducing tokenizer trait (#9287) · ff0cf51c
  Simo Lin authored Aug 17, 2025
  
  ff0cf51c
- [router] add cargo clippy in CI and fix-up linting errors (#9242) · ce3ca9b0
  Jeff Nettleton authored Aug 17, 2025
  
  ce3ca9b0
15 Aug, 2025 1 commit
- [router] allow more health check configuration (#9198) · 21b88460
  Simo Lin authored Aug 15, 2025
  
  21b88460
11 Aug, 2025 1 commit
- [router] regular router circuit breaker (#8997) · 067068f2
  Simo Lin authored Aug 10, 2025
  
  067068f2
08 Aug, 2025 1 commit
- [router] router circuit breaker core (#8941) · 61a46804
  Simo Lin authored Aug 08, 2025
  
  61a46804
05 Aug, 2025 1 commit
- [pd-router] Add Configurable Retry Logic for reduce backend pressure (#8744) · 354ac435
  Simo Lin authored Aug 04, 2025
  
  354ac435
31 Jul, 2025 1 commit
- [router] migrate router from actix to axum (#8479) · 66a398f4
  Simo Lin authored Jul 30, 2025
  
  66a398f4
30 Jul, 2025 1 commit
- [feature] [sgl-router] Add a dp-aware routing strategy (#6869) · a730ce81
  Rui Chen authored Jul 30, 2025
  
  a730ce81
28 Jul, 2025 1 commit
- [router] improve router logs and request id header (#8415) · fe6a445d
  Simo Lin authored Jul 27, 2025
  
  fe6a445d
27 Jul, 2025 1 commit
- [router] add different policies for p node and d node (#8395) · 2ab97023
  Simo Lin authored Jul 27, 2025
  
  2ab97023
19 Jul, 2025 1 commit
- [router] router metrics cleanup (#8158) · 8fcc55cf
  Simo Lin authored Jul 18, 2025
  
  8fcc55cf
18 Jul, 2025 1 commit

[router] Refactor router and policy traits with dependency injection (#7987) · c8f31042

Simo Lin authored Jul 18, 2025


Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>

c8f31042

12 Jul, 2025 1 commit
- [router] add worker abstraction (#7960) · f2d5c492
  Simo Lin authored Jul 11, 2025
  
  f2d5c492
03 Jul, 2025 1 commit
- [router] add --log-level to sgl-router (#6512) · 82f021e2
  Zilin Zhu authored Jul 03, 2025
  
  82f021e2
29 Jun, 2025 1 commit
- [bugfix] fix runtime dropping panic in editable (#7628) · e3f9b548
  Simo Lin authored Jun 29, 2025
  
  e3f9b548
27 Jun, 2025 1 commit
- [router] add centralized configuration module for sgl-router (#7588) · c071198c
  Simo Lin authored Jun 27, 2025
  
  c071198c
23 Jun, 2025 1 commit
- [misc] Add PD service discovery support in router (#7361) · 30f2a44a
  Simo Lin authored Jun 22, 2025
  
  30f2a44a
18 Jun, 2025 1 commit
- Merge PDLB (Prefill-Decode Load Balancer) into SGLang Router (#7096) · 09ae5b20
  Simo Lin authored Jun 18, 2025
  
  09ae5b20
25 May, 2025 1 commit
- Sgl-router Prometheus metrics endpoint and usage track metrics (#6537) · 1a399799
  Chao Yang authored May 24, 2025
  
  1a399799
29 Apr, 2025 1 commit
- [Misc] add service discovery for sgl router · 1468769b
  Simo Lin authored Apr 29, 2025
  
  1468769b
27 Apr, 2025 1 commit
- [Misc] add structure logging, write to file and log tracing for SGL Router · f0365820
  Simo Lin authored Apr 27, 2025
  
  f0365820