Commits · edd86b8853ebb8878bc0a160951ff3e1d7d805e0 · change / sglang

"vscode:/vscode.git/clone" did not exist on "00b7a61c1c0f2c33d5df92ef851201ed28b66e1b"

08 Oct, 2025 1 commit
- [router][grpc] Refactor chat handler in grpc/ to use centralized orchestrator (#11314) · edd86b88
  Chang Su authored Oct 07, 2025
```
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  edd86b88
07 Oct, 2025 3 commits
- [router] support Openai router conversation API CRUD (#11297) · 4ed67c27
  Keyang Ru authored Oct 07, 2025
  
  4ed67c27
- [router][grpc] Fix error message format in grpc chat handler (#11307) · 420c99ac
  Chang Su authored Oct 07, 2025
  
  420c99ac
- [router] add reasoning and tool parser argument in router (#11290) · 79d34951
  Simo Lin authored Oct 07, 2025
  
  79d34951
06 Oct, 2025 3 commits
- [router][grpc] Refine streaming processes (#11277) · b07c9c76
  Chang Su authored Oct 06, 2025
  
  b07c9c76
- [router][tool call] Clean up redundant `detect_format` and `has_tool_markers` (#11270) · 466992b2
  Chang Su authored Oct 06, 2025
  
  466992b2
- [router] add ipv6 support across all components (#11219) · 5ee777c9
  Simo Lin authored Oct 06, 2025
  
  5ee777c9
04 Oct, 2025 1 commit
- [router] add grpc router pd mode for chat and generate (#11140) · d736e0b6
  Simo Lin authored Oct 04, 2025
  
  d736e0b6
03 Oct, 2025 1 commit
- [router] Steaming support for MCP Tool Calls in OpenAI Router (#11173) · 34151f17
  Keyang Ru authored Oct 03, 2025
  
  34151f17
02 Oct, 2025 2 commits
- [router][grpc] Support streaming for v1/chat/completions (#11179) · 963175d5
  Chang Su authored Oct 02, 2025
  
  963175d5
- [router][grpc] Support tool call parser in streaming (#11160) · b658be6f
  Chang Su authored Oct 02, 2025
  
  b658be6f
01 Oct, 2025 2 commits
- [router] Add multi-turn tool calling loop support for MCP integration (#11143) · a28b394f
  Keyang Ru authored Oct 01, 2025
  
  a28b394f
- [router] add mcp list and mcp call in output array (#11112) · 7fb551a7
  Keyang Ru authored Sep 30, 2025
  
  7fb551a7
30 Sep, 2025 3 commits
- [router][bugfix] Fix input_logprobs handling with None value and `logprob_start_len = -1` (#11113) · 8ce830a8
  Chang Su authored Sep 30, 2025
  
  8ce830a8
- [router][tool call] Full support for ToolChoice (#11085) · d1676cd4
  Chang Su authored Sep 29, 2025
```
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  d1676cd4
- [router] grpc router generate endpoint support (#11070) · 33b3c0f8
  Simo Lin authored Sep 30, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  33b3c0f8
29 Sep, 2025 2 commits
- [router][grpc] Add logprobs support to router (#11082) · 5937a56d
  Chang Su authored Sep 29, 2025
  
  5937a56d
- [router] Use `get_pooled` in `process_single_choice` (#11079) · f065e5be
  Chang Su authored Sep 29, 2025
  
  f065e5be
28 Sep, 2025 1 commit
- [router] basic mcp support for openai router response api (#10978) · 72392f29
  Keyang Ru authored Sep 27, 2025
  
  72392f29
27 Sep, 2025 3 commits
- [router][tool parser] Modify tool parser to return both normal text and tool... · c1c8dd1d
  Chang Su authored Sep 27, 2025
```
[router][tool parser] Modify tool parser to return both normal text and tool calls (non-stream) (#10995)
```
  c1c8dd1d
- [router][grpc] Support E2E non-stream chat completions (#10980) · 37f3325b
  Chang Su authored Sep 26, 2025
  
  37f3325b
- [router][grpc] Add helpfer functions for decoder in router.rs and fix specs (#10971) · 0c3db889
  Chang Su authored Sep 26, 2025
  
  0c3db889
26 Sep, 2025 6 commits
- [router] remove old/oudated/useless comments across code base (#10968) · aae7ead2
  Simo Lin authored Sep 26, 2025
  
  aae7ead2
- [router] grpc router regular mode import cleanup (#10963) · be059b83
  Simo Lin authored Sep 26, 2025
  
  be059b83
- [router] add move grpc worker management from router to worker manager (#10960) · 5d4fe1ce
  Simo Lin authored Sep 26, 2025
  
  5d4fe1ce
- [router] move grpc client from router to worker and builder (#10958) · 1b011e68
  Simo Lin authored Sep 26, 2025
  
  1b011e68
- [router] add grpc client get and set (#10955) · 1e57b947
  Simo Lin authored Sep 26, 2025
  
  1e57b947
- router: Support parallel sampling num > 1 in grpc_server and non-stream handling (#10929) · 37158f20
  Chang Su authored Sep 25, 2025
  
  37158f20
25 Sep, 2025 4 commits
- refactor: Move `grpc/client.rs` to `grpc_client/sglang_scheduler.rs` (#10924) · 5e21d6ae
  Chang Su authored Sep 25, 2025
  
  5e21d6ae
- router: Fix constraint proto and `build_constraint` in grpc router (#10881) · 91678474
  Chang Su authored Sep 25, 2025
  
  91678474
- [router] consolidate worker load monitoring (#10894) · d511b2d9
  Simo Lin authored Sep 25, 2025
  
  d511b2d9
- [router] consolidate worker get loads (#10880) · e7387035
  Simo Lin authored Sep 24, 2025
  
  e7387035
24 Sep, 2025 4 commits
- [router] consolidate health endpoints and flush cache (#10876) · 7a06ef98
  Simo Lin authored Sep 24, 2025
  
  7a06ef98
- router-grpc: Add tools processing and other paramters for apply_chat_template (#10877) · 4a87ba21
  Chang Su authored Sep 24, 2025
  
  4a87ba21
- [router] select first healthy worker on proxied get requests (#10827) · c3faf2d6
  luna authored Sep 24, 2025
  
  c3faf2d6
- router-grpc: Support jinja chat template content format detection (#10832) · 9209b209
  Chang Su authored Sep 24, 2025
  
  9209b209
23 Sep, 2025 4 commits
- [router] Support streaming for Openai Router Response api (#10822) · f4e3ebeb
  Keyang Ru authored Sep 23, 2025
  
  f4e3ebeb
- router(grpc): Implement route for chat_cmpl endpoint (#10761) · 7ff93e61
  Chang Su authored Sep 23, 2025
  
  7ff93e61
- [router] responses api POST and GET with local storage (#10581) · 98c3b04f
  Simo Lin authored Sep 23, 2025
```
Co-authored-by: key4ng <rukeyang@gmail.com>
```
  98c3b04f
- [router] remove pd router draining channel (#10767) · c3a1d775
  Simo Lin authored Sep 22, 2025
  
  c3a1d775