Commits · 00eb5eb7213c7b75984ef44eae80bda2228d4cfd · change / sglang · GitLab

19 Sep, 2025 1 commit
- [router] refactor router and worker management 2/n (#10666) · 00eb5eb7
  Simo Lin authored Sep 19, 2025
  
  00eb5eb7
16 Sep, 2025 3 commits
- [router] fix router manager and router init in server (#10499) · 5fe39e85
  Chang Su authored Sep 15, 2025
  
  5fe39e85
- [router] add router db connector for responses api (#10487) · 16e93359
  Simo Lin authored Sep 16, 2025
  
  16e93359
- [router] fix worker registration in multi model mode (#10486) · 35ef3f29
  Chang Su authored Sep 15, 2025
  
  35ef3f29
15 Sep, 2025 3 commits
- [router] minor code clean up in server startup (#10470) · b93acd70
  Chang Su authored Sep 15, 2025
  
  b93acd70
- [router] fix logger ordering git ctx (#10457) · 69b35793
  Chang Su authored Sep 14, 2025
  
  69b35793
- [router]: Add Embedding routing logic (#10129) · f9ee6ae1
  Jintao Zhang authored Sep 15, 2025
```
Signed-off-by: Jintao Zhang <zhangjintao9020@gmail.com>
Co-authored-by: Waël Boukhobza <wawa_wael@live.fr>
```
  f9ee6ae1
12 Sep, 2025 4 commits
- [router] Add get and cancel method for response api (#10387) · 366043db
  Keyang Ru authored Sep 12, 2025
  
  366043db
- [router] allow one router to support different model families and serving mode (#10244) · 2f173ea0
  Simo Lin authored Sep 12, 2025
  
  2f173ea0
- [router] Add Rerank Routing Logic in Regular Router (#10219) · 4634fd59
  Frank Fang authored Sep 13, 2025
  
  4634fd59
- [router] Basic OAI Response api (#10346) · a23bdeaf
  Keyang Ru authored Sep 11, 2025
  
  a23bdeaf
04 Sep, 2025 1 commit
- [router] move tokenizer, reasoning, tool initialization to server (#9996) · d966b902
  Simo Lin authored Sep 03, 2025
  
  d966b902
26 Aug, 2025 1 commit
- [router] add token bucket rate limiter (#9656) · 90313fb0
  Chang Su authored Aug 26, 2025
  
  90313fb0
22 Aug, 2025 1 commit
- [router] Move all protocols to spec.rs file (#9519) · 5ef545e6
  Keyang Ru authored Aug 22, 2025
  
  5ef545e6
19 Aug, 2025 1 commit
- [router]restructure protocol modules for better organization (#9321) · ce67b2d5
  Keyang Ru authored Aug 18, 2025
  
  ce67b2d5
12 Aug, 2025 1 commit
- [router] Add Rust Binary Entrypoint for SGLang Router (#9089) · 9d68bdb2
  Simo Lin authored Aug 11, 2025
  
  9d68bdb2
07 Aug, 2025 1 commit
- [router] fix req handling order, improve serialization, remove retry (#8888) · a69b6370
  Simo Lin authored Aug 06, 2025
  
  a69b6370
03 Aug, 2025 1 commit
- [router] Implement HTTP Dependency Injection Pattern for Router System (#8714) · 828a4fe9
  Simo Lin authored Aug 02, 2025
  
  828a4fe9
31 Jul, 2025 1 commit
- [router] migrate router from actix to axum (#8479) · 66a398f4
  Simo Lin authored Jul 30, 2025
  
  66a398f4
28 Jul, 2025 1 commit
- [router] improve router logs and request id header (#8415) · fe6a445d
  Simo Lin authored Jul 27, 2025
  
  fe6a445d
19 Jul, 2025 1 commit
- [router] router metrics cleanup (#8158) · 8fcc55cf
  Simo Lin authored Jul 18, 2025
  
  8fcc55cf
18 Jul, 2025 1 commit

[router] Refactor router and policy traits with dependency injection (#7987) · c8f31042

Simo Lin authored Jul 18, 2025


Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>

c8f31042

12 Jul, 2025 1 commit
- [router] add worker abstraction (#7960) · f2d5c492
  Simo Lin authored Jul 11, 2025
  
  f2d5c492
03 Jul, 2025 1 commit
- [router] add --log-level to sgl-router (#6512) · 82f021e2
  Zilin Zhu authored Jul 03, 2025
  
  82f021e2
18 Jun, 2025 1 commit
- Merge PDLB (Prefill-Decode Load Balancer) into SGLang Router (#7096) · 09ae5b20
  Simo Lin authored Jun 18, 2025
  
  09ae5b20
02 Jun, 2025 1 commit
- [Router] Fix k8s Service Discovery (#6766) · ff914748
  Arthur Cheng authored Jun 02, 2025
```
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  ff914748
25 May, 2025 1 commit
- Sgl-router Prometheus metrics endpoint and usage track metrics (#6537) · 1a399799
  Chao Yang authored May 24, 2025
  
  1a399799
21 May, 2025 1 commit
- [router] support http2 in router (#6487) · 669caa0a
  Zilin Zhu authored May 21, 2025
  
  669caa0a
17 May, 2025 1 commit
- [router] Add /list_workers endpoint to router (#6366) · e3bed74a
  Zilin Zhu authored May 18, 2025
  
  e3bed74a
29 Apr, 2025 1 commit
- [Misc] add service discovery for sgl router · 1468769b
  Simo Lin authored Apr 29, 2025
  
  1468769b
27 Apr, 2025 1 commit
- [Misc] add structure logging, write to file and log tracing for SGL Router · f0365820
  Simo Lin authored Apr 27, 2025
  
  f0365820
17 Mar, 2025 1 commit

[sgl-router] improvement to avoid hang (#4482) · f4d7ab7a

Yinghai Lu authored Mar 17, 2025


Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>

f4d7ab7a

24 Jan, 2025 1 commit
- [router] Forward all request headers from router to workers (#3070) · 9a0cc2e9
  Byron Hsu authored Jan 23, 2025
  
  9a0cc2e9
20 Jan, 2025 1 commit
- [router] Expose worker startup secs & Return error instead of panic for router init (#3016) · 0311ce8e
  Byron Hsu authored Jan 20, 2025
  
  0311ce8e
12 Dec, 2024 2 commits
- Rename rust folder to sgl-router (#2464) · e3b3acfa
  Ata Fatahi authored Dec 12, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  e3b3acfa
- Make request payload size configurable (#2444) · 2ac36b9a
  Ata Fatahi authored Dec 11, 2024
```
Signed-off-by: Ata Fatahi <immrata@gmail.com>
```
  2ac36b9a
11 Dec, 2024 3 commits
- [router] Update doc for dynamic scaling and fault tolerance (#2454) · c0ee46fe
  Byron Hsu authored Dec 11, 2024
  
  c0ee46fe
- [router] Use borrow if possible to save cost (#2441) · 0fb88aaa
  Byron Hsu authored Dec 11, 2024
  
  0fb88aaa
- [router] Refactor: decouple select and send stage (#2440) · d4de9a62
  Byron Hsu authored Dec 11, 2024
  
  d4de9a62
09 Dec, 2024 1 commit
- [router] add health checking in router init (#2393) · 6387098f
  Byron Hsu authored Dec 08, 2024
  
  6387098f