Commits · fccac7d126b18320b22dfac8a0c8db76161dab4a · change / sglang · GitLab

08 Oct, 2025 7 commits
- [router][grpc] Add dependencies in Cargo.toml to support chat template rendering (#11342) · fccac7d1
  Chang Su authored Oct 08, 2025
  
  fccac7d1
- [router] Support history management using conversation (#11339) · 7ac6b900
  Keyang Ru authored Oct 08, 2025
  
  7ac6b900
- [router] Fix all unused_qualifications (#11341) · a1080b72
  Chang Su authored Oct 08, 2025
  
  a1080b72
- [router][grpc] Cleanup debug logs in grpc_server and grpc_router (#11340) · a65ca739
  Chang Su authored Oct 08, 2025
  
  a65ca739
- [router] improve reasoning parser lock and reduce req cloning (#11336) · 677aa0e2
  Simo Lin authored Oct 08, 2025
  
  677aa0e2
- [router] refactor generate to use new pipeline arch (#11323) · 01c9ee1a
  Simo Lin authored Oct 08, 2025
  
  01c9ee1a
- [router][grpc] Refactor chat handler in grpc/ to use centralized orchestrator (#11314) · edd86b88
  Chang Su authored Oct 07, 2025
```
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  edd86b88
07 Oct, 2025 8 commits
- [router] cleanup worker health check to return early (#11310) · fde9b963
  Simo Lin authored Oct 07, 2025
  
  fde9b963
- [router] support Openai router conversation API CRUD (#11297) · 4ed67c27
  Keyang Ru authored Oct 07, 2025
  
  4ed67c27
- [router][grpc] Fix error message format in grpc chat handler (#11307) · 420c99ac
  Chang Su authored Oct 07, 2025
  
  420c99ac
- [router] fix grpc connection conversion and add optimization (#11305) · f4affd4d
  Simo Lin authored Oct 07, 2025
  
  f4affd4d
- [router][grpc] Refactor chat template content format detection (#11288) · 64582caa
  Chang Su authored Oct 07, 2025
  
  64582caa
- [router] add get server info and get model info in grpc server (#11303) · 2fcd56ea
  Simo Lin authored Oct 07, 2025
  
  2fcd56ea
- [router] add reasoning and tool parser argument in router (#11290) · 79d34951
  Simo Lin authored Oct 07, 2025
  
  79d34951
- [router][grpc] Fix proto3 default value mismatches and cleanup unused fields (#11283) · a578d300
  Chang Su authored Oct 06, 2025
  
  a578d300
06 Oct, 2025 3 commits
- [router][grpc] Refine streaming processes (#11277) · b07c9c76
  Chang Su authored Oct 06, 2025
  
  b07c9c76
- [router][tool call] Clean up redundant `detect_format` and `has_tool_markers` (#11270) · 466992b2
  Chang Su authored Oct 06, 2025
  
  466992b2
- [router] add ipv6 support across all components (#11219) · 5ee777c9
  Simo Lin authored Oct 06, 2025
  
  5ee777c9
04 Oct, 2025 2 commits
- [router] add grpc router pd mode for chat and generate (#11140) · d736e0b6
  Simo Lin authored Oct 04, 2025
  
  d736e0b6
- [router] fix get load response parsing (#11213) · ffd03a9b
  Simo Lin authored Oct 04, 2025
  
  ffd03a9b
03 Oct, 2025 1 commit
- [router] Steaming support for MCP Tool Calls in OpenAI Router (#11173) · 34151f17
  Keyang Ru authored Oct 03, 2025
  
  34151f17
02 Oct, 2025 3 commits
- [router][grpc] Support streaming for v1/chat/completions (#11179) · 963175d5
  Chang Su authored Oct 02, 2025
  
  963175d5
- Remove dp balance metadata and minimul token balance. (#11170) · 7ff740a6
  Liangsheng Yin authored Oct 03, 2025
  
  7ff740a6
- [router][grpc] Support tool call parser in streaming (#11160) · b658be6f
  Chang Su authored Oct 02, 2025
  
  b658be6f
01 Oct, 2025 2 commits
- [router] Add multi-turn tool calling loop support for MCP integration (#11143) · a28b394f
  Keyang Ru authored Oct 01, 2025
  
  a28b394f
- [router] add mcp list and mcp call in output array (#11112) · 7fb551a7
  Keyang Ru authored Sep 30, 2025
  
  7fb551a7
30 Sep, 2025 3 commits
- [router][bugfix] Fix input_logprobs handling with None value and `logprob_start_len = -1` (#11113) · 8ce830a8
  Chang Su authored Sep 30, 2025
  
  8ce830a8
- [router][tool call] Full support for ToolChoice (#11085) · d1676cd4
  Chang Su authored Sep 29, 2025
```
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  d1676cd4
- [router] grpc router generate endpoint support (#11070) · 33b3c0f8
  Simo Lin authored Sep 30, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  33b3c0f8
29 Sep, 2025 7 commits
- [router][grpc] Add logprobs support to router (#11082) · 5937a56d
  Chang Su authored Sep 29, 2025
  
  5937a56d
- [router] Use `get_pooled` in `process_single_choice` (#11079) · f065e5be
  Chang Su authored Sep 29, 2025
  
  f065e5be
- [router][tool call] Separate `JsonParser` and `LlamaParser` (#11073) · 4eeaff74
  Chang Su authored Sep 29, 2025
  
  4eeaff74
- [router] add n to generate sampling params (#11069) · 816b3a43
  Simo Lin authored Sep 29, 2025
  
  816b3a43
- [router][tool call] Improve normal content extraction and error handling (non-stream) (#11050) · af4ab656
  Chang Su authored Sep 29, 2025
  
  af4ab656
- [router] add harmony tool parser base structure and interface (#11036) · 25728863
  Simo Lin authored Sep 28, 2025
  
  25728863
- [router][tool call] Support normal content extraction before tool call (streaming) (#11038) · dba751a8
  Chang Su authored Sep 28, 2025
  
  dba751a8
28 Sep, 2025 4 commits
- [router] migrate to rust python module for pythonic parser (#11033) · 336e9a60
  Simo Lin authored Sep 28, 2025
  
  336e9a60
- Update GLM-4.5 Model Doc (#11017) · abb67815
  Yuxuan Zhang authored Sep 29, 2025
  
  abb67815
- [router] fix chat template loading and tokenizer path (#10999) · 5519766a
  Simo Lin authored Sep 27, 2025
  
  5519766a
- [router] basic mcp support for openai router response api (#10978) · 72392f29
  Keyang Ru authored Sep 27, 2025
  
  72392f29