Commits · bbf261ae4a9deaaacd6f570fc92cee23fd9a4342 · change / sglang · GitLab

04 Sep, 2025 3 commits
- [router] fix grpc connection mode detection (#9999) · bbf261ae
  Simo Lin authored Sep 04, 2025
  
  bbf261ae
- [router] clean up dependency injector to use ctx (#10000) · 4f8a982d
  Simo Lin authored Sep 04, 2025
  
  4f8a982d
- [router] move tokenizer, reasoning, tool initialization to server (#9996) · d966b902
  Simo Lin authored Sep 03, 2025
  
  d966b902
03 Sep, 2025 2 commits
- [router] add chat_template_kwargs in ChatCompletionRequest (#9958) · 5e19b159
  Tony Lu authored Sep 04, 2025
```
Signed-off-by: Tony Lu <tonylu@linux.alibaba.com>
```
  5e19b159
- [router] Add Rerank API Specification (#9906) · 788b19a5
  Frank Fang authored Sep 03, 2025
  
  788b19a5
02 Sep, 2025 4 commits
- Grpc client (#9939) · 11dcabc5
  Chang Su authored Sep 02, 2025
  
  11dcabc5
- [router] fix FunctionCallResponse proto, support arguments is null (#9875) · 21e1bc47
  Bruce-x-1997 authored Sep 02, 2025
```
Co-authored-by: forestlee95 <forestlee95@foxmail.com>
```
  21e1bc47
- [router] add grpc pd and regular router init (#9893) · 9a0cac1b
  Chang Su authored Sep 01, 2025
  
  9a0cac1b
- [router] Fix short timeout for the prefill client (#9803) · 9d9fa9a5
  LukasBluebaum authored Sep 02, 2025
  
  9d9fa9a5
01 Sep, 2025 1 commit
- [router] add tokenizer download support from hf hub (#9882) · 598c0bc1
  Chang Su authored Sep 01, 2025
  
  598c0bc1
31 Aug, 2025 2 commits
- [router] global tool parser registry (#9840) · c112bcc4
  Chang Su authored Aug 30, 2025
  
  c112bcc4
- [router] add reasoning parser readme (#9837) · 92d79646
  Simo Lin authored Aug 30, 2025
  
  92d79646
28 Aug, 2025 5 commits
- [router] grpc router bootstraps (#9759) · 53430588
  Simo Lin authored Aug 28, 2025
  
  53430588
- [router] add llama3.2 multi json streaming parser (#9735) · 07c9d8fb
  Simo Lin authored Aug 28, 2025
  
  07c9d8fb
- [router] additional llama32 parser unit test and multi json support (#9732) · e1f7cf57
  Simo Lin authored Aug 27, 2025
  
  e1f7cf57
- [router] Add MCP Tool Handler (#9615) · 3f2d0cef
  Keyang Ru authored Aug 27, 2025
  
  3f2d0cef
- [router] fix error response in pd_router (#9505) · 8b30bec2
  Bruce-x-1997 authored Aug 28, 2025
```
Co-authored-by: bruce.xu <bruce.xu@gmicloud.ai>
```
  8b30bec2
27 Aug, 2025 5 commits
- [router] add gpt-oss and glm4 tool parser (#9703) · 07ee0ab7
  Simo Lin authored Aug 27, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  07ee0ab7
- [router] add kimi-k2 tool parser (#9702) · 5c06dcb7
  Simo Lin authored Aug 27, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  5c06dcb7
- [router] add step3 tool parser (#9695) · 6f6beca4
  Simo Lin authored Aug 27, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  6f6beca4
- [router] add deepseek tool parser (#9694) · 6e4e1c8c
  Simo Lin authored Aug 27, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  6e4e1c8c
- [router] restructure tool parser module folder (#9693) · 9768c50d
  Simo Lin authored Aug 27, 2025
  
  9768c50d
26 Aug, 2025 7 commits
- [router] add token bucket rate limiter (#9656) · 90313fb0
  Chang Su authored Aug 26, 2025
  
  90313fb0
- [router] address worker load tracking consistency (#9523) · 3578eb1e
  Simo Lin authored Aug 26, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  3578eb1e
- [router] add ut for mistral, llama, pythonic, and streaming tool parser (#9632) · e2e378ca
  Simo Lin authored Aug 25, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  e2e378ca
- [router] add llama tool parser (#9629) · dc1decc6
  Simo Lin authored Aug 25, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  dc1decc6
- [router] add pythonic parser (#9628) · 03680f33
  Simo Lin authored Aug 25, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  03680f33
- [router] add qwen tool parser (#9623) · d4c5e534
  Simo Lin authored Aug 25, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  d4c5e534
- [router] add mistral tool parser (#9622) · 817c62a0
  Simo Lin authored Aug 25, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  817c62a0
24 Aug, 2025 1 commit
- [router] add right rustls dependency in sgl-router cargo.toml (#9498) · 9e169ea8
  Bruce-x-1997 authored Aug 25, 2025
```
Co-authored-by: bruce.xu <bruce.xu@gmicloud.ai>
```
  9e169ea8
22 Aug, 2025 7 commits
- [router] ignore client error when record failure in pd_router (#9503) · 446c8e4c
  Bruce-x-1997 authored Aug 23, 2025
```
Co-authored-by: bruce.xu <bruce.xu@gmicloud.ai>
```
  446c8e4c
- [router] Move all protocols to spec.rs file (#9519) · 5ef545e6
  Keyang Ru authored Aug 22, 2025
  
  5ef545e6
- [router] add json tool parser (#9516) · f556ac8b
  Simo Lin authored Aug 22, 2025
  
  f556ac8b
- [router] tokenizer arch doc (#9513) · 49f9d025
  Simo Lin authored Aug 22, 2025
  
  49f9d025
- [router] fix router load guard tracking for streaming (#9491) · 0f8cee8c
  Simo Lin authored Aug 21, 2025
  
  0f8cee8c
- [router] add tool parser base structure and partial json parser (#9482) · 816c4c85
  Chang Su authored Aug 21, 2025
  
  816c4c85
- [router] remove all tokenizer metrics for performance (#9474) · 53e2cd46
  Chang Su authored Aug 21, 2025
  
  53e2cd46
21 Aug, 2025 2 commits
- [router] add glm and step3 reasoning parser (#9415) · 5cfbb4c1
  Chang Su authored Aug 20, 2025
  
  5cfbb4c1
- [router] Add IGW (Inference Gateway) Feature Flag (#9371) · 3828db43
  Keyang Ru authored Aug 20, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  3828db43
20 Aug, 2025 1 commit
- [router] Implement OpenAI Responses API specification (#9367) · 5ae5ecaa
  Keyang Ru authored Aug 19, 2025
  
  5ae5ecaa