Commits · d7f0d88fa2d3ef044091565c5c86c54784c812b3 · change / sglang · GitLab

24 Oct, 2025 1 commit
- [router] implement response api get input item function and refactor input/output store (#11924) · d7f0d88f
  Keyang Ru authored Oct 24, 2025
  
  d7f0d88f
22 Oct, 2025 3 commits
- [router] create worker removal step and clean up worker manager (#11921) · 5dccf697
  Simo Lin authored Oct 22, 2025
  
  5dccf697
- [router][grpc] Fix background tasks stored with wrong id (#11945) · 590bc4b7
  Chang Su authored Oct 21, 2025
  
  590bc4b7
- [router][grpc] Support `v1/responses` API (#11926) · 70f6309c
  Chang Su authored Oct 21, 2025
  
  70f6309c
21 Oct, 2025 1 commit
- [router][grpc] Remove `continue_final_message` in `ChatTemplateParams` and add... · e69094df
  Chang Su authored Oct 20, 2025
```
[router][grpc] Remove `continue_final_message` in `ChatTemplateParams` and add `minijinja-contrib` (#11882)
```
  e69094df
19 Oct, 2025 2 commits
- [2/2] [feature] support openai like classification api in router (#11670) · d513ee93
  ybyang authored Oct 19, 2025
  
  d513ee93
- [router] Add Configurable L0 and L1 Tokenizer Caching (#11688) · a7ae61ed
  Simo Lin authored Oct 18, 2025
  
  a7ae61ed
18 Oct, 2025 1 commit
- [router][grpc] Support parallel queue puts in grpc_request_manager and remove... · ca240eef
  Chang Su authored Oct 17, 2025
```
[router][grpc] Support parallel queue puts in grpc_request_manager and remove mutex for grpc_client (#11798)
```
  ca240eef
17 Oct, 2025 1 commit
- [router] Add rustfmt and set group imports by default (#11732) · dc01313d
  Chang Su authored Oct 16, 2025
  
  dc01313d
16 Oct, 2025 2 commits
- [router] fix p and d worker filtering and bootstrap port handling (#11729) · 64affab4
  Simo Lin authored Oct 16, 2025
  
  64affab4
- [Router] Refactor protocol definitions: split spec.rs into modular files (#11677) · 4c9bcb9d
  Keyang Ru authored Oct 16, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  4c9bcb9d
14 Oct, 2025 2 commits
- [router] update generate spec to align with sgl io struct (#11591) · 0b9915c1
  Simo Lin authored Oct 14, 2025
  
  0b9915c1
- [router][protocols] Add Axum validate extractor and use it for... · 27ef1459
  Chang Su authored Oct 13, 2025
```
[router][protocols] Add Axum validate extractor and use it for `/v1/chat/completions` endpoint (#11588)
```
  27ef1459
13 Oct, 2025 2 commits
- [router][grpc] Add error handling to `generate_tool_constraints` (#11562) · 4b694e7d
  Chang Su authored Oct 13, 2025
  
  4b694e7d
- [router][grpc] Further delegate non-stream processing to `processing.rs` (#11553) · 7b59b0b8
  Chang Su authored Oct 13, 2025
  
  7b59b0b8
11 Oct, 2025 2 commits
- [router][grpc] Consolidate parser checks for chat completions (#11439) · 92777135
  Chang Su authored Oct 10, 2025
  
  92777135
- [router] leverage RAII to actively cancel request during client disconnect (#11399) · c4958331
  Simo Lin authored Oct 10, 2025
  
  c4958331
09 Oct, 2025 1 commit
- [router][grpc] Fix streaming bugs: empty tool names, state pollution, and panics (#11373) · ab926dd6
  Chang Su authored Oct 09, 2025
  
  ab926dd6
08 Oct, 2025 5 commits
- [router] Fix all unused_qualifications (#11341) · a1080b72
  Chang Su authored Oct 08, 2025
  
  a1080b72
- [router][grpc] Cleanup debug logs in grpc_server and grpc_router (#11340) · a65ca739
  Chang Su authored Oct 08, 2025
  
  a65ca739
- [router] improve reasoning parser lock and reduce req cloning (#11336) · 677aa0e2
  Simo Lin authored Oct 08, 2025
  
  677aa0e2
- [router] refactor generate to use new pipeline arch (#11323) · 01c9ee1a
  Simo Lin authored Oct 08, 2025
  
  01c9ee1a
- [router][grpc] Refactor chat handler in grpc/ to use centralized orchestrator (#11314) · edd86b88
  Chang Su authored Oct 07, 2025
```
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  edd86b88
07 Oct, 2025 2 commits
- [router][grpc] Fix error message format in grpc chat handler (#11307) · 420c99ac
  Chang Su authored Oct 07, 2025
  
  420c99ac
- [router] add reasoning and tool parser argument in router (#11290) · 79d34951
  Simo Lin authored Oct 07, 2025
  
  79d34951
06 Oct, 2025 2 commits
- [router][grpc] Refine streaming processes (#11277) · b07c9c76
  Chang Su authored Oct 06, 2025
  
  b07c9c76
- [router][tool call] Clean up redundant `detect_format` and `has_tool_markers` (#11270) · 466992b2
  Chang Su authored Oct 06, 2025
  
  466992b2
04 Oct, 2025 1 commit
- [router] add grpc router pd mode for chat and generate (#11140) · d736e0b6
  Simo Lin authored Oct 04, 2025
  
  d736e0b6
02 Oct, 2025 2 commits
- [router][grpc] Support streaming for v1/chat/completions (#11179) · 963175d5
  Chang Su authored Oct 02, 2025
  
  963175d5
- [router][grpc] Support tool call parser in streaming (#11160) · b658be6f
  Chang Su authored Oct 02, 2025
  
  b658be6f
30 Sep, 2025 3 commits
- [router][bugfix] Fix input_logprobs handling with None value and `logprob_start_len = -1` (#11113) · 8ce830a8
  Chang Su authored Sep 30, 2025
  
  8ce830a8
- [router][tool call] Full support for ToolChoice (#11085) · d1676cd4
  Chang Su authored Sep 29, 2025
```
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  d1676cd4
- [router] grpc router generate endpoint support (#11070) · 33b3c0f8
  Simo Lin authored Sep 30, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  33b3c0f8
29 Sep, 2025 2 commits
- [router][grpc] Add logprobs support to router (#11082) · 5937a56d
  Chang Su authored Sep 29, 2025
  
  5937a56d
- [router] Use `get_pooled` in `process_single_choice` (#11079) · f065e5be
  Chang Su authored Sep 29, 2025
  
  f065e5be
27 Sep, 2025 3 commits
- [router][tool parser] Modify tool parser to return both normal text and tool... · c1c8dd1d
  Chang Su authored Sep 27, 2025
```
[router][tool parser] Modify tool parser to return both normal text and tool calls (non-stream) (#10995)
```
  c1c8dd1d
- [router][grpc] Support E2E non-stream chat completions (#10980) · 37f3325b
  Chang Su authored Sep 26, 2025
  
  37f3325b
- [router][grpc] Add helpfer functions for decoder in router.rs and fix specs (#10971) · 0c3db889
  Chang Su authored Sep 26, 2025
  
  0c3db889
26 Sep, 2025 2 commits
- [router] remove old/oudated/useless comments across code base (#10968) · aae7ead2
  Simo Lin authored Sep 26, 2025
  
  aae7ead2
- [router] grpc router regular mode import cleanup (#10963) · be059b83
  Simo Lin authored Sep 26, 2025
  
  be059b83