Commits · d511b2d905177ebc4040186ffb1493414e190a80 · change / sglang · GitLab

25 Sep, 2025 4 commits
- [router] consolidate worker load monitoring (#10894) · d511b2d9
  Simo Lin authored Sep 25, 2025
  
  d511b2d9
- [router] simplify tokenizer dev doc (#10895) · 458c0219
  Simo Lin authored Sep 25, 2025
  
  458c0219
- [router] Support Oracle DB(ATP) Data Connector (#10845) · a73eb8cd
  Keyang Ru authored Sep 24, 2025
  
  a73eb8cd
- [router] consolidate worker get loads (#10880) · e7387035
  Simo Lin authored Sep 24, 2025
  
  e7387035
24 Sep, 2025 4 commits
- [router] consolidate health endpoints and flush cache (#10876) · 7a06ef98
  Simo Lin authored Sep 24, 2025
  
  7a06ef98
- router-grpc: Add tools processing and other paramters for apply_chat_template (#10877) · 4a87ba21
  Chang Su authored Sep 24, 2025
  
  4a87ba21
- [router] select first healthy worker on proxied get requests (#10827) · c3faf2d6
  luna authored Sep 24, 2025
  
  c3faf2d6
- router-grpc: Support jinja chat template content format detection (#10832) · 9209b209
  Chang Su authored Sep 24, 2025
  
  9209b209
23 Sep, 2025 9 commits
- [router] add auth middleware for api key auth (#10826) · ee704e62
  Chang Su authored Sep 23, 2025
  
  ee704e62
- [router] Support streaming for Openai Router Response api (#10822) · f4e3ebeb
  Keyang Ru authored Sep 23, 2025
  
  f4e3ebeb
- [router] fix axum default body limit (#10818) · 08b8c0c3
  Chang Su authored Sep 23, 2025
  
  08b8c0c3
- router(grpc): Implement route for chat_cmpl endpoint (#10761) · 7ff93e61
  Chang Su authored Sep 23, 2025
  
  7ff93e61
- [router] use dashmap for radix tree instead of hash for multi model (#10814) · b24b2e7e
  Simo Lin authored Sep 23, 2025
  
  b24b2e7e
- [router] responses api POST and GET with local storage (#10581) · 98c3b04f
  Simo Lin authored Sep 23, 2025
```
Co-authored-by: key4ng <rukeyang@gmail.com>
```
  98c3b04f
- [router] fix cache aware routing strategy and lock contention (#10773) · ddab4fc7
  Simo Lin authored Sep 23, 2025
  
  ddab4fc7
- [router] remove pd router draining channel (#10767) · c3a1d775
  Simo Lin authored Sep 22, 2025
  
  c3a1d775
- [router] refactor router and worker management 4/n (#10756) · 89971c4c
  Simo Lin authored Sep 22, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  89971c4c
22 Sep, 2025 3 commits
- [router] refactor router and worker management 3/n (#10727) · 97c38239
  Simo Lin authored Sep 22, 2025
  
  97c38239
- bugfix: Fix `get_worker_urls_for_model` in http/router.rs (#10754) · 60dbbd08
  Chang Su authored Sep 22, 2025
  
  60dbbd08
- [2/2] Support deterministic inference for temperature > 0 (#10678) · e2ac7888
  Qiaolin Yu authored Sep 21, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
```
  e2ac7888
21 Sep, 2025 1 commit
- [Router]fix: fix get_load missing api_key (#10385) · 56321e9f
  Jimmy authored Sep 22, 2025
  
  56321e9f
20 Sep, 2025 1 commit
- [router] refactor router and worker management 2.5/n (#10677) · 1d1ce624
  Simo Lin authored Sep 19, 2025
  
  1d1ce624
19 Sep, 2025 7 commits
- router-spec: Reorder `ChatCompletionRequest` and fix validation logic (#10675) · 03ce92e5
  Chang Su authored Sep 19, 2025
  
  03ce92e5
- [router] refactor router and worker management 2/n (#10666) · 00eb5eb7
  Simo Lin authored Sep 19, 2025
  
  00eb5eb7
- [router] refactor router and worker management 1/n (#10664) · 36efd5be
  Simo Lin authored Sep 19, 2025
  
  36efd5be
- [router] refactor worker to builder pattern 5/n (#10653) · 873d858b
  Simo Lin authored Sep 19, 2025
  
  873d858b
- [router] refactor worker to builder pattern 4/n (#10650) · 4f2055ad
  Simo Lin authored Sep 19, 2025
  
  4f2055ad
- [router] refactor worker to builder pattern 3/n (#10647) · ac2a723b
  Simo Lin authored Sep 19, 2025
  
  ac2a723b
- [router] refactor worker to builder pattern 2/n (#10633) · 780d6a22
  Simo Lin authored Sep 19, 2025
  
  780d6a22
18 Sep, 2025 1 commit
- [router] refactor worker to builder pattern 1/n (#10628) · 5291f32d
  Simo Lin authored Sep 18, 2025
  
  5291f32d
16 Sep, 2025 3 commits
- [router] fix router manager and router init in server (#10499) · 5fe39e85
  Chang Su authored Sep 15, 2025
  
  5fe39e85
- [router] add router db connector for responses api (#10487) · 16e93359
  Simo Lin authored Sep 16, 2025
  
  16e93359
- [router] fix worker registration in multi model mode (#10486) · 35ef3f29
  Chang Su authored Sep 15, 2025
  
  35ef3f29
15 Sep, 2025 5 commits
- [router] multi model registration fix (#10481) · 2689f0bf
  Chang Su authored Sep 15, 2025
  
  2689f0bf
- [router] minor code clean up in server startup (#10470) · b93acd70
  Chang Su authored Sep 15, 2025
  
  b93acd70
- [router] fix logger ordering git ctx (#10457) · 69b35793
  Chang Su authored Sep 14, 2025
  
  69b35793
- [router] fix service discovery and mcp ut (#10449) · 7eccbe99
  Simo Lin authored Sep 15, 2025
  
  7eccbe99
- [router]: Add Embedding routing logic (#10129) · f9ee6ae1
  Jintao Zhang authored Sep 15, 2025
```
Signed-off-by: Jintao Zhang <zhangjintao9020@gmail.com>
Co-authored-by: Waël Boukhobza <wawa_wael@live.fr>
```
  f9ee6ae1
12 Sep, 2025 2 commits
- [router] add not implemented functions for multi model trait (#10394) · 7c5a0a1b
  Simo Lin authored Sep 12, 2025
  
  7c5a0a1b
- [router] Add get and cancel method for response api (#10387) · 366043db
  Keyang Ru authored Sep 12, 2025
  
  366043db