Commits · db37422c92f7ad5e972a5ef09f00986c4f922f5d · change / sglang · GitLab

06 Sep, 2025 1 commit
- [router] move to mcp sdk instead (#10057) · db37422c
  Simo Lin authored Sep 05, 2025
  
  db37422c
04 Sep, 2025 1 commit
- [router] move tokenizer, reasoning, tool initialization to server (#9996) · d966b902
  Simo Lin authored Sep 03, 2025
  
  d966b902
02 Sep, 2025 2 commits
- [router] include rust benchamrks (#9932) · 9491d6e5
  Simo Lin authored Sep 02, 2025
  
  9491d6e5
- [router] add grpc pd and regular router init (#9893) · 9a0cac1b
  Chang Su authored Sep 01, 2025
  
  9a0cac1b
01 Sep, 2025 1 commit
- [router] add tokenizer download support from hf hub (#9882) · 598c0bc1
  Chang Su authored Sep 01, 2025
  
  598c0bc1
28 Aug, 2025 5 commits
- [router] grpc router bootstraps (#9759) · 53430588
  Simo Lin authored Aug 28, 2025
  
  53430588
- [router] add llama3.2 multi json streaming parser (#9735) · 07c9d8fb
  Simo Lin authored Aug 28, 2025
  
  07c9d8fb
- [router] additional llama32 parser unit test and multi json support (#9732) · e1f7cf57
  Simo Lin authored Aug 27, 2025
  
  e1f7cf57
- [router] additional pythonic parser unit test (#9730) · 2bb9d454
  Simo Lin authored Aug 27, 2025
  
  2bb9d454
- [router] Add MCP Tool Handler (#9615) · 3f2d0cef
  Keyang Ru authored Aug 27, 2025
  
  3f2d0cef
27 Aug, 2025 4 commits
- [router] add gpt-oss and glm4 tool parser (#9703) · 07ee0ab7
  Simo Lin authored Aug 27, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  07ee0ab7
- [router] add kimi-k2 tool parser (#9702) · 5c06dcb7
  Simo Lin authored Aug 27, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  5c06dcb7
- [router] add step3 tool parser (#9695) · 6f6beca4
  Simo Lin authored Aug 27, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  6f6beca4
- [router] add deepseek tool parser (#9694) · 6e4e1c8c
  Simo Lin authored Aug 27, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  6e4e1c8c
26 Aug, 2025 3 commits
- [router] add token bucket rate limiter (#9656) · 90313fb0
  Chang Su authored Aug 26, 2025
  
  90313fb0
- Fix lint for router (#9636) · cbc0e4d7
  Stefan He authored Aug 26, 2025
  
  cbc0e4d7
- [router] add ut for mistral, llama, pythonic, and streaming tool parser (#9632) · e2e378ca
  Simo Lin authored Aug 25, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  e2e378ca
22 Aug, 2025 2 commits
- [router] Move all protocols to spec.rs file (#9519) · 5ef545e6
  Keyang Ru authored Aug 22, 2025
  
  5ef545e6
- [router] remove all tokenizer metrics for performance (#9474) · 53e2cd46
  Chang Su authored Aug 21, 2025
  
  53e2cd46
21 Aug, 2025 3 commits
- [router] add tokenizer benchmark (#9427) · 78ae1758
  Simo Lin authored Aug 21, 2025
  
  78ae1758
- [router] add tokenizer integration test with real mini tokenizer (#9413) · e6523102
  Chang Su authored Aug 20, 2025
  
  e6523102
- [router] Add IGW (Inference Gateway) Feature Flag (#9371) · 3828db43
  Keyang Ru authored Aug 20, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  3828db43
20 Aug, 2025 2 commits
- [router] Implement OpenAI Responses API specification (#9367) · 5ae5ecaa
  Keyang Ru authored Aug 19, 2025
  
  5ae5ecaa
- [router] add tokenizer chat template support (#9370) · 5fbad308
  Simo Lin authored Aug 19, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  5fbad308
19 Aug, 2025 1 commit
- [router]restructure protocol modules for better organization (#9321) · ce67b2d5
  Keyang Ru authored Aug 18, 2025
  
  ce67b2d5
17 Aug, 2025 1 commit
- [router] add cargo clippy in CI and fix-up linting errors (#9242) · ce3ca9b0
  Jeff Nettleton authored Aug 17, 2025
  
  ce3ca9b0
15 Aug, 2025 1 commit
- [router] allow more health check configuration (#9198) · 21b88460
  Simo Lin authored Aug 15, 2025
  
  21b88460
12 Aug, 2025 1 commit
- [router] Add Rust Binary Entrypoint for SGLang Router (#9089) · 9d68bdb2
  Simo Lin authored Aug 11, 2025
  
  9d68bdb2
11 Aug, 2025 1 commit
- [router] regular router circuit breaker (#8997) · 067068f2
  Simo Lin authored Aug 10, 2025
  
  067068f2
08 Aug, 2025 1 commit
- [router] router circuit breaker core (#8941) · 61a46804
  Simo Lin authored Aug 08, 2025
  
  61a46804
07 Aug, 2025 1 commit
- [router] fix req handling order, improve serialization, remove retry (#8888) · a69b6370
  Simo Lin authored Aug 06, 2025
  
  a69b6370
06 Aug, 2025 2 commits
- [router] PD Router Simplification and Reorganization (#8838) · 8c7bb39d
  Simo Lin authored Aug 05, 2025
  
  8c7bb39d
- [router] complete router oai spec (#8828) · 5d62b56f
  Simo Lin authored Aug 05, 2025
  
  5d62b56f
05 Aug, 2025 1 commit
- [pd-router] Add Configurable Retry Logic for reduce backend pressure (#8744) · 354ac435
  Simo Lin authored Aug 04, 2025
  
  354ac435
03 Aug, 2025 1 commit
- [router] Implement HTTP Dependency Injection Pattern for Router System (#8714) · 828a4fe9
  Simo Lin authored Aug 02, 2025
  
  828a4fe9
31 Jul, 2025 1 commit
- [router] migrate router from actix to axum (#8479) · 66a398f4
  Simo Lin authored Jul 30, 2025
  
  66a398f4
30 Jul, 2025 1 commit
- [feature] [sgl-router] Add a dp-aware routing strategy (#6869) · a730ce81
  Rui Chen authored Jul 30, 2025
  
  a730ce81
28 Jul, 2025 1 commit
- [router] improve router logs and request id header (#8415) · fe6a445d
  Simo Lin authored Jul 27, 2025
  
  fe6a445d
27 Jul, 2025 1 commit
- [router] add different policies for p node and d node (#8395) · 2ab97023
  Simo Lin authored Jul 27, 2025
  
  2ab97023
24 Jul, 2025 1 commit
- [router] add request format unit test (#8300) · 39fe1e88
  Simo Lin authored Jul 24, 2025
  
  39fe1e88