Commits · 4b62af92ef3632863e288af802ef63f40efbb503 · change / sglang

14 Oct, 2025 1 commit
- [router] change worker api to async instead of sync (#11566) · 4b62af92
  Simo Lin authored Oct 14, 2025
  
  4b62af92
09 Oct, 2025 1 commit
- [router] change grpc client from mutable to clone (#11394) · 88bb627d
  Simo Lin authored Oct 09, 2025
  
  88bb627d
08 Oct, 2025 1 commit
- [router] Fix all unused_qualifications (#11341) · a1080b72
  Chang Su authored Oct 08, 2025
  
  a1080b72
07 Oct, 2025 1 commit
- [router] cleanup worker health check to return early (#11310) · fde9b963
  Simo Lin authored Oct 07, 2025
  
  fde9b963
06 Oct, 2025 1 commit
- [router] add ipv6 support across all components (#11219) · 5ee777c9
  Simo Lin authored Oct 06, 2025
  
  5ee777c9
04 Oct, 2025 2 commits
- [router] add grpc router pd mode for chat and generate (#11140) · d736e0b6
  Simo Lin authored Oct 04, 2025
  
  d736e0b6
- [router] fix get load response parsing (#11213) · ffd03a9b
  Simo Lin authored Oct 04, 2025
  
  ffd03a9b
26 Sep, 2025 4 commits
- [router] remove old/oudated/useless comments across code base (#10968) · aae7ead2
  Simo Lin authored Sep 26, 2025
  
  aae7ead2
- [router] add move grpc worker management from router to worker manager (#10960) · 5d4fe1ce
  Simo Lin authored Sep 26, 2025
  
  5d4fe1ce
- [router] move grpc client from router to worker and builder (#10958) · 1b011e68
  Simo Lin authored Sep 26, 2025
  
  1b011e68
- [router] add grpc client get and set (#10955) · 1e57b947
  Simo Lin authored Sep 26, 2025
  
  1e57b947
25 Sep, 2025 3 commits
- refactor: Move `grpc/client.rs` to `grpc_client/sglang_scheduler.rs` (#10924) · 5e21d6ae
  Chang Su authored Sep 25, 2025
  
  5e21d6ae
- [router] consolidate worker load monitoring (#10894) · d511b2d9
  Simo Lin authored Sep 25, 2025
  
  d511b2d9
- [router] consolidate worker get loads (#10880) · e7387035
  Simo Lin authored Sep 24, 2025
  
  e7387035
24 Sep, 2025 1 commit
- [router] consolidate health endpoints and flush cache (#10876) · 7a06ef98
  Simo Lin authored Sep 24, 2025
  
  7a06ef98
22 Sep, 2025 1 commit
- [router] refactor router and worker management 3/n (#10727) · 97c38239
  Simo Lin authored Sep 22, 2025
  
  97c38239
21 Sep, 2025 1 commit
- [Router]fix: fix get_load missing api_key (#10385) · 56321e9f
  Jimmy authored Sep 22, 2025
  
  56321e9f
19 Sep, 2025 3 commits
- [router] refactor worker to builder pattern 5/n (#10653) · 873d858b
  Simo Lin authored Sep 19, 2025
  
  873d858b
- [router] refactor worker to builder pattern 4/n (#10650) · 4f2055ad
  Simo Lin authored Sep 19, 2025
  
  4f2055ad
- [router] refactor worker to builder pattern 2/n (#10633) · 780d6a22
  Simo Lin authored Sep 19, 2025
  
  780d6a22
18 Sep, 2025 1 commit
- [router] refactor worker to builder pattern 1/n (#10628) · 5291f32d
  Simo Lin authored Sep 18, 2025
  
  5291f32d
16 Sep, 2025 1 commit
- [router] fix worker registration in multi model mode (#10486) · 35ef3f29
  Chang Su authored Sep 15, 2025
  
  35ef3f29
15 Sep, 2025 1 commit
- [router] fix service discovery and mcp ut (#10449) · 7eccbe99
  Simo Lin authored Sep 15, 2025
  
  7eccbe99
12 Sep, 2025 2 commits
- [router] allow one router to support different model families and serving mode (#10244) · 2f173ea0
  Simo Lin authored Sep 12, 2025
  
  2f173ea0
- [router] enable sccache in ci and local build (#10099) · 8c86595c
  Simo Lin authored Sep 12, 2025
  
  8c86595c
04 Sep, 2025 2 commits
- [router] fix grpc connection mode detection (#9999) · bbf261ae
  Simo Lin authored Sep 04, 2025
  
  bbf261ae
- [router] move tokenizer, reasoning, tool initialization to server (#9996) · d966b902
  Simo Lin authored Sep 03, 2025
  
  d966b902
02 Sep, 2025 1 commit
- Grpc client (#9939) · 11dcabc5
  Chang Su authored Sep 02, 2025
  
  11dcabc5
28 Aug, 2025 1 commit
- [router] grpc router bootstraps (#9759) · 53430588
  Simo Lin authored Aug 28, 2025
  
  53430588
26 Aug, 2025 2 commits
- [router] add token bucket rate limiter (#9656) · 90313fb0
  Chang Su authored Aug 26, 2025
  
  90313fb0
- [router] address worker load tracking consistency (#9523) · 3578eb1e
  Simo Lin authored Aug 26, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  3578eb1e
17 Aug, 2025 1 commit
- [router] add cargo clippy in CI and fix-up linting errors (#9242) · ce3ca9b0
  Jeff Nettleton authored Aug 17, 2025
  
  ce3ca9b0
15 Aug, 2025 2 commits
- [router] clean up lint warnings with clippy execution (#9201) · d7e38b2f
  Jeff Nettleton authored Aug 15, 2025
  
  d7e38b2f
- [router] allow more health check configuration (#9198) · 21b88460
  Simo Lin authored Aug 15, 2025
  
  21b88460
11 Aug, 2025 2 commits
- [pd-router] add retry and circuit breakfor for pd router (#9051) · 6f81a710
  Simo Lin authored Aug 11, 2025
  
  6f81a710
- [router] regular router circuit breaker (#8997) · 067068f2
  Simo Lin authored Aug 10, 2025
  
  067068f2
08 Aug, 2025 2 commits
- [router] add metrics for worker and policy (#8971) · 36bfddec
  Tony Lu authored Aug 09, 2025
```
Signed-off-by: Tony Lu <tonyluj@gmail.com>
```
  36bfddec
- [router] router circuit breaker core (#8941) · 61a46804
  Simo Lin authored Aug 08, 2025
  
  61a46804
07 Aug, 2025 1 commit

refactor(sgl-router): Replace `once_cell` with `LazyLock` in worker.rs and... · fd05b567

Tien Nguyen authored Aug 07, 2025

refactor(sgl-router): Replace `once_cell` with `LazyLock` in worker.rs and remove once_cell dependency from Cargo.toml (#8698)

fd05b567

04 Aug, 2025 1 commit
- [router] introduce dp worker abstraction (#8639) · 2fa0462c
  Simo Lin authored Aug 04, 2025
  
  2fa0462c