Commits · ddcba74b4df6ea31a4f823d4ef5bb73b8daac9f3 · change / sglang

21 Oct, 2025 1 commit
- [router] Worker Management Workflow Engine (#11868) · ddcba74b
  Simo Lin authored Oct 20, 2025
  
  ddcba74b
19 Oct, 2025 1 commit
- [2/2] [feature] support openai like classification api in router (#11670) · d513ee93
  ybyang authored Oct 19, 2025
  
  d513ee93
17 Oct, 2025 2 commits
- [router][grpc] Remove timeout for connections and remove `max_tokens`... · d1984e21
  Chang Su authored Oct 17, 2025
```
[router][grpc] Remove timeout for connections and remove `max_tokens` deprecation warning log (#11775)
```
  d1984e21
- [router] Add rustfmt and set group imports by default (#11732) · dc01313d
  Chang Su authored Oct 16, 2025
  
  dc01313d
16 Oct, 2025 2 commits
- [router] Fix tool_choice normalization in ChatCompletionRequest and fix ut (#11731) · c7962868
  Chang Su authored Oct 16, 2025
  
  c7962868
- [Router] Refactor protocol definitions: split spec.rs into modular files (#11677) · 4c9bcb9d
  Keyang Ru authored Oct 16, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  4c9bcb9d
15 Oct, 2025 1 commit
- [router] Fix response api related spec (#11621) · d2478cd4
  Keyang Ru authored Oct 15, 2025
  
  d2478cd4
14 Oct, 2025 4 commits
- [router] delete useless table content comment in spec (#11597) · 28ad2297
  Simo Lin authored Oct 14, 2025
  
  28ad2297
- [router] change worker api to async instead of sync (#11566) · 4b62af92
  Simo Lin authored Oct 14, 2025
  
  4b62af92
- [router] update generate spec to align with sgl io struct (#11591) · 0b9915c1
  Simo Lin authored Oct 14, 2025
  
  0b9915c1
- [router][protocols] Add Axum validate extractor and use it for... · 27ef1459
  Chang Su authored Oct 13, 2025
```
[router][protocols] Add Axum validate extractor and use it for `/v1/chat/completions` endpoint (#11588)
```
  27ef1459
13 Oct, 2025 1 commit
- [router] openai router: support grok model (#11511) · 63e84352
  Keyang Ru authored Oct 12, 2025
  
  63e84352
08 Oct, 2025 3 commits
- [router] Support history management using conversation (#11339) · 7ac6b900
  Keyang Ru authored Oct 08, 2025
  
  7ac6b900
- [router] refactor generate to use new pipeline arch (#11323) · 01c9ee1a
  Simo Lin authored Oct 08, 2025
  
  01c9ee1a
- [router][grpc] Refactor chat handler in grpc/ to use centralized orchestrator (#11314) · edd86b88
  Chang Su authored Oct 07, 2025
```
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  edd86b88
04 Oct, 2025 1 commit
- [router] add grpc router pd mode for chat and generate (#11140) · d736e0b6
  Simo Lin authored Oct 04, 2025
  
  d736e0b6
02 Oct, 2025 1 commit
- [router][grpc] Support streaming for v1/chat/completions (#11179) · 963175d5
  Chang Su authored Oct 02, 2025
  
  963175d5
01 Oct, 2025 2 commits
- [router] Add multi-turn tool calling loop support for MCP integration (#11143) · a28b394f
  Keyang Ru authored Oct 01, 2025
  
  a28b394f
- [router] add mcp list and mcp call in output array (#11112) · 7fb551a7
  Keyang Ru authored Sep 30, 2025
  
  7fb551a7
30 Sep, 2025 1 commit
- [router][tool call] Full support for ToolChoice (#11085) · d1676cd4
  Chang Su authored Sep 29, 2025
```
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  d1676cd4
29 Sep, 2025 1 commit
- [router] add n to generate sampling params (#11069) · 816b3a43
  Simo Lin authored Sep 29, 2025
  
  816b3a43
28 Sep, 2025 1 commit
- [router] basic mcp support for openai router response api (#10978) · 72392f29
  Keyang Ru authored Sep 27, 2025
  
  72392f29
27 Sep, 2025 2 commits
- [router][grpc] Support E2E non-stream chat completions (#10980) · 37f3325b
  Chang Su authored Sep 26, 2025
  
  37f3325b
- [router][grpc] Add helpfer functions for decoder in router.rs and fix specs (#10971) · 0c3db889
  Chang Su authored Sep 26, 2025
  
  0c3db889
26 Sep, 2025 1 commit
- [router] remove old/oudated/useless comments across code base (#10968) · aae7ead2
  Simo Lin authored Sep 26, 2025
  
  aae7ead2
25 Sep, 2025 1 commit
- [router] consolidate worker get loads (#10880) · e7387035
  Simo Lin authored Sep 24, 2025
  
  e7387035
24 Sep, 2025 1 commit
- [router] consolidate health endpoints and flush cache (#10876) · 7a06ef98
  Simo Lin authored Sep 24, 2025
  
  7a06ef98
23 Sep, 2025 1 commit
- [router] responses api POST and GET with local storage (#10581) · 98c3b04f
  Simo Lin authored Sep 23, 2025
```
Co-authored-by: key4ng <rukeyang@gmail.com>
```
  98c3b04f
22 Sep, 2025 1 commit
- [2/2] Support deterministic inference for temperature > 0 (#10678) · e2ac7888
  Qiaolin Yu authored Sep 21, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
```
  e2ac7888
21 Sep, 2025 1 commit
- [Router]fix: fix get_load missing api_key (#10385) · 56321e9f
  Jimmy authored Sep 22, 2025
  
  56321e9f
19 Sep, 2025 1 commit
- router-spec: Reorder `ChatCompletionRequest` and fix validation logic (#10675) · 03ce92e5
  Chang Su authored Sep 19, 2025
  
  03ce92e5
15 Sep, 2025 1 commit

[router]: Add Embedding routing logic (#10129) · f9ee6ae1

Jintao Zhang authored Sep 15, 2025


Signed-off-by: Jintao Zhang <zhangjintao9020@gmail.com>
Co-authored-by: Waël Boukhobza <wawa_wael@live.fr>

f9ee6ae1

12 Sep, 2025 2 commits
- [router] allow one router to support different model families and serving mode (#10244) · 2f173ea0
  Simo Lin authored Sep 12, 2025
  
  2f173ea0
- [router] Add Rerank Routing Logic in Regular Router (#10219) · 4634fd59
  Frank Fang authored Sep 13, 2025
  
  4634fd59
03 Sep, 2025 2 commits
- [router] add chat_template_kwargs in ChatCompletionRequest (#9958) · 5e19b159
  Tony Lu authored Sep 04, 2025
```
Signed-off-by: Tony Lu <tonylu@linux.alibaba.com>
```
  5e19b159
- [router] Add Rerank API Specification (#9906) · 788b19a5
  Frank Fang authored Sep 03, 2025
  
  788b19a5
02 Sep, 2025 1 commit
- [router] fix FunctionCallResponse proto, support arguments is null (#9875) · 21e1bc47
  Bruce-x-1997 authored Sep 02, 2025
```
Co-authored-by: forestlee95 <forestlee95@foxmail.com>
```
  21e1bc47
22 Aug, 2025 1 commit
- [router] Move all protocols to spec.rs file (#9519) · 5ef545e6
  Keyang Ru authored Aug 22, 2025
  
  5ef545e6
20 Aug, 2025 1 commit
- [router] Implement OpenAI Responses API specification (#9367) · 5ae5ecaa
  Keyang Ru authored Aug 19, 2025
  
  5ae5ecaa
19 Aug, 2025 1 commit
- [Router] Add validation module for API parameters (#9335) · c5057262
  Keyang Ru authored Aug 19, 2025
  
  c5057262