Commits · 4f8a982d52b57a8b65c92a895dfe39fbe4d5b1ad · change / sglang

"...lm-evaluation-harness.git" did not exist on "1a159d6bb33c789a5a924b266e3dcde5d6e7eb17"

04 Sep, 2025 2 commits
- [router] clean up dependency injector to use ctx (#10000) · 4f8a982d
  Simo Lin authored Sep 04, 2025
  
  4f8a982d
- [router] move tokenizer, reasoning, tool initialization to server (#9996) · d966b902
  Simo Lin authored Sep 03, 2025
  
  d966b902
02 Sep, 2025 3 commits
- Grpc client (#9939) · 11dcabc5
  Chang Su authored Sep 02, 2025
  
  11dcabc5
- [router] add grpc pd and regular router init (#9893) · 9a0cac1b
  Chang Su authored Sep 01, 2025
  
  9a0cac1b
- [router] Fix short timeout for the prefill client (#9803) · 9d9fa9a5
  LukasBluebaum authored Sep 02, 2025
  
  9d9fa9a5
28 Aug, 2025 2 commits
- [router] grpc router bootstraps (#9759) · 53430588
  Simo Lin authored Aug 28, 2025
  
  53430588
- [router] fix error response in pd_router (#9505) · 8b30bec2
  Bruce-x-1997 authored Aug 28, 2025
```
Co-authored-by: bruce.xu <bruce.xu@gmicloud.ai>
```
  8b30bec2
26 Aug, 2025 1 commit
- [router] address worker load tracking consistency (#9523) · 3578eb1e
  Simo Lin authored Aug 26, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  3578eb1e
22 Aug, 2025 3 commits
- [router] ignore client error when record failure in pd_router (#9503) · 446c8e4c
  Bruce-x-1997 authored Aug 23, 2025
```
Co-authored-by: bruce.xu <bruce.xu@gmicloud.ai>
```
  446c8e4c
- [router] Move all protocols to spec.rs file (#9519) · 5ef545e6
  Keyang Ru authored Aug 22, 2025
  
  5ef545e6
- [router] fix router load guard tracking for streaming (#9491) · 0f8cee8c
  Simo Lin authored Aug 21, 2025
  
  0f8cee8c
21 Aug, 2025 1 commit
- [router] Add IGW (Inference Gateway) Feature Flag (#9371) · 3828db43
  Keyang Ru authored Aug 20, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  3828db43
19 Aug, 2025 1 commit
- [router]restructure protocol modules for better organization (#9321) · ce67b2d5
  Keyang Ru authored Aug 18, 2025
  
  ce67b2d5
17 Aug, 2025 3 commits
- [router] introduce prefill response draining for http compliance (#9281) · b341b7db
  Simo Lin authored Aug 17, 2025
  
  b341b7db
- [router] add cargo clippy in CI and fix-up linting errors (#9242) · ce3ca9b0
  Jeff Nettleton authored Aug 17, 2025
  
  ce3ca9b0
- [router] fix pd prefill http request complinace issue (#9237) · bb10e3a1
  Simo Lin authored Aug 16, 2025
  
  bb10e3a1
15 Aug, 2025 3 commits
- [router] preserve original worker response header in router (#9236) · da53e13c
  Simo Lin authored Aug 15, 2025
  
  da53e13c
- [router] clean up lint warnings with clippy execution (#9201) · d7e38b2f
  Jeff Nettleton authored Aug 15, 2025
  
  d7e38b2f
- [router] allow more health check configuration (#9198) · 21b88460
  Simo Lin authored Aug 15, 2025
  
  21b88460
12 Aug, 2025 1 commit
- [router] Add Rust Binary Entrypoint for SGLang Router (#9089) · 9d68bdb2
  Simo Lin authored Aug 11, 2025
  
  9d68bdb2
11 Aug, 2025 3 commits
- refactor(pd-router): extract common patterns to reduce code duplication (#9081) · 38907fe6
  Simo Lin authored Aug 11, 2025
  
  38907fe6
- [pd-router] add retry and circuit breakfor for pd router (#9051) · 6f81a710
  Simo Lin authored Aug 11, 2025
  
  6f81a710
- [router] regular router circuit breaker (#8997) · 067068f2
  Simo Lin authored Aug 10, 2025
  
  067068f2
08 Aug, 2025 4 commits
- [router] fix radix tree integration issues in PD router (#8982) · 7b7e5615
  Simo Lin authored Aug 08, 2025
  
  7b7e5615
- [router] harden retries + metrics; fix streaming load; header filtering (#8972) · a59cbea9
  Simo Lin authored Aug 08, 2025
  
  a59cbea9
- [router] router circuit breaker core (#8941) · 61a46804
  Simo Lin authored Aug 08, 2025
  
  61a46804
- [router] dedicated prefill HTTP client and request-path optimizations (#8923) · 2e901e89
  Simo Lin authored Aug 07, 2025
  
  2e901e89
07 Aug, 2025 1 commit
- [router] fix req handling order, improve serialization, remove retry (#8888) · a69b6370
  Simo Lin authored Aug 06, 2025
  
  a69b6370
06 Aug, 2025 2 commits
- [router] PD Router Simplification and Reorganization (#8838) · 8c7bb39d
  Simo Lin authored Aug 05, 2025
  
  8c7bb39d
- [router] complete router oai spec (#8828) · 5d62b56f
  Simo Lin authored Aug 05, 2025
  
  5d62b56f
05 Aug, 2025 1 commit
- [pd-router] Add Configurable Retry Logic for reduce backend pressure (#8744) · 354ac435
  Simo Lin authored Aug 04, 2025
  
  354ac435
03 Aug, 2025 1 commit
- [router] Implement HTTP Dependency Injection Pattern for Router System (#8714) · 828a4fe9
  Simo Lin authored Aug 02, 2025
  
  828a4fe9
02 Aug, 2025 1 commit
- [router] minor code clean up and and refactoring (#8711) · 6d4fd882
  Simo Lin authored Aug 02, 2025
  
  6d4fd882
01 Aug, 2025 1 commit
- [bug] limit bootstrap room to to [0, 2^63 - 1] (#8684) · ab9b893e
  Simo Lin authored Aug 01, 2025
  
  ab9b893e
31 Jul, 2025 1 commit
- [router] migrate router from actix to axum (#8479) · 66a398f4
  Simo Lin authored Jul 30, 2025
  
  66a398f4
30 Jul, 2025 1 commit
- [feature] [sgl-router] Add a dp-aware routing strategy (#6869) · a730ce81
  Rui Chen authored Jul 30, 2025
  
  a730ce81
28 Jul, 2025 1 commit
- [router] improve router logs and request id header (#8415) · fe6a445d
  Simo Lin authored Jul 27, 2025
  
  fe6a445d
27 Jul, 2025 1 commit
- [router] add different policies for p node and d node (#8395) · 2ab97023
  Simo Lin authored Jul 27, 2025
  
  2ab97023
24 Jul, 2025 1 commit
- [router] fix pd model completion request (#8303) · f6e07f27
  Simo Lin authored Jul 23, 2025
  
  f6e07f27
22 Jul, 2025 1 commit
- fix: sgl-router remove dead code (#8257) · c33499a6
  Rui Chen authored Jul 22, 2025
  
  c33499a6