Commits · c8f31042a85fe49c19e5dd2b38bc8356d2bf9e94 · change / sglang

18 Jul, 2025 1 commit

[router] Refactor router and policy traits with dependency injection (#7987) · c8f31042

Simo Lin authored Jul 18, 2025


Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>

c8f31042

12 Jul, 2025 1 commit
- [router] add worker abstraction (#7960) · f2d5c492
  Simo Lin authored Jul 11, 2025
  
  f2d5c492
10 Jul, 2025 1 commit
- [bugfix] add pd router policy validation (#7904) · 4ed57807
  Simo Lin authored Jul 09, 2025
  
  4ed57807
09 Jul, 2025 1 commit
- [router] Update metrics when request completes (#7899) · 7590f522
  Shuaiyi Zhang authored Jul 09, 2025
  
  7590f522
08 Jul, 2025 1 commit
- [router] forward stream_options in request (#7860) · 51ae4030
  Shuaiyi Zhang authored Jul 08, 2025
  
  51ae4030
07 Jul, 2025 3 commits
- [misc] release new router version (#7798) · 3646f6bb
  Simo Lin authored Jul 06, 2025
  
  3646f6bb
- [docs] update router readme (#7797) · 35724aa1
  Simo Lin authored Jul 06, 2025
  
  35724aa1
- [bugfix] Fix sgl-router get_server_info endpoint compatibility issue (#7813) · ea3e7ffe
  Simo Lin authored Jul 06, 2025
  
  ea3e7ffe
03 Jul, 2025 1 commit
- [router] add --log-level to sgl-router (#6512) · 82f021e2
  Zilin Zhu authored Jul 03, 2025
  
  82f021e2
29 Jun, 2025 2 commits
- [bugfix] fix runtime dropping panic in editable (#7628) · e3f9b548
  Simo Lin authored Jun 29, 2025
  
  e3f9b548
- Fix sgl-router startup crash (#7619) · b3cff365
  finetune authored Jun 29, 2025
  
  b3cff365
27 Jun, 2025 1 commit
- [router] add centralized configuration module for sgl-router (#7588) · c071198c
  Simo Lin authored Jun 27, 2025
  
  c071198c
25 Jun, 2025 1 commit
- [ci] add router benchmark script and CI (#7498) · 3abc3036
  Simo Lin authored Jun 25, 2025
  
  3abc3036
23 Jun, 2025 1 commit
- [misc] Add PD service discovery support in router (#7361) · 30f2a44a
  Simo Lin authored Jun 22, 2025
  
  30f2a44a
18 Jun, 2025 1 commit
- Merge PDLB (Prefill-Decode Load Balancer) into SGLang Router (#7096) · 09ae5b20
  Simo Lin authored Jun 18, 2025
  
  09ae5b20
02 Jun, 2025 1 commit
- [Router] Fix k8s Service Discovery (#6766) · ff914748
  Arthur Cheng authored Jun 02, 2025
```
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  ff914748
25 May, 2025 1 commit
- Sgl-router Prometheus metrics endpoint and usage track metrics (#6537) · 1a399799
  Chao Yang authored May 24, 2025
  
  1a399799
21 May, 2025 1 commit
- [router] support http2 in router (#6487) · 669caa0a
  Zilin Zhu authored May 21, 2025
  
  669caa0a
20 May, 2025 1 commit
- Remove `Cargo.lock`, add it into .gitignore (#6438) · 17d080b7
  Liangsheng Yin authored May 20, 2025
  
  17d080b7
17 May, 2025 2 commits
- Use monotonic clock for interval measurement (#6211) · 3cf1473a
  Lifu Huang authored May 17, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  3cf1473a
- [router] Add /list_workers endpoint to router (#6366) · e3bed74a
  Zilin Zhu authored May 18, 2025
  
  e3bed74a
11 May, 2025 2 commits
- Replace time.time() to time.perf_counter() for benchmarking. (#6178) · 6e2da515
  Lifu Huang authored May 11, 2025
```
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
```
  6e2da515
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
29 Apr, 2025 2 commits
- [fix]: PyO3 macOS linking and consolidate on tracing for logging · 771669cb
  Simo Lin authored Apr 29, 2025
  
  771669cb
- [Misc] add service discovery for sgl router · 1468769b
  Simo Lin authored Apr 29, 2025
  
  1468769b
27 Apr, 2025 1 commit
- [Misc] add structure logging, write to file and log tracing for SGL Router · f0365820
  Simo Lin authored Apr 27, 2025
  
  f0365820
17 Mar, 2025 2 commits
- [sgl-router] improvement to avoid hang (#4482) · f4d7ab7a
  Yinghai Lu authored Mar 17, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
```
  f4d7ab7a
- Fix router test (#4483) · 8cc300f5
  Byron Hsu authored Mar 16, 2025
  
  8cc300f5
04 Mar, 2025 1 commit
- sgl-router - issues on routing and project build. (#3870) (#3948) · 37373ef2
  Michael Feil authored Mar 04, 2025
  
  37373ef2
24 Jan, 2025 3 commits
- [router] Fix twine uploading (#3095) · 3ed0a547
  Byron Hsu authored Jan 23, 2025
  
  3ed0a547
- bump router to 0.1.4 (#3094) · 8d8ef849
  Byron Hsu authored Jan 23, 2025
  
  8d8ef849
- [router] Forward all request headers from router to workers (#3070) · 9a0cc2e9
  Byron Hsu authored Jan 23, 2025
  
  9a0cc2e9
23 Jan, 2025 1 commit
- [router] make error actionable (#3063) · 5de50653
  Byron Hsu authored Jan 22, 2025
  
  5de50653
20 Jan, 2025 5 commits
- bump router to 0.1.3 (#3020) · 3ad4cd49
  Byron Hsu authored Jan 20, 2025
  
  3ad4cd49
- [router] Expose worker startup interval (#3019) · 3a8428ec
  Byron Hsu authored Jan 20, 2025
  
  3a8428ec
- [router] Expose worker startup secs & Return error instead of panic for router init (#3016) · 0311ce8e
  Byron Hsu authored Jan 20, 2025
  
  0311ce8e
- Separate two entry points: Engine and HTTP server (#2996) · 03464890
  Lianmin Zheng authored Jan 19, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  03464890
- Improve metrics, logging, and importing orders (#2992) · cd493b5a
  Lianmin Zheng authored Jan 19, 2025
  
  cd493b5a
19 Jan, 2025 1 commit
- [router] Allow empty worker list for sglang.launch_router (#2979) · ef18b0ed
  Byron Hsu authored Jan 19, 2025
  
  ef18b0ed
13 Jan, 2025 1 commit
- docs: update link (#2857) · 41d7e5b7
  Yineng Zhang authored Jan 13, 2025
  
  41d7e5b7