Commits · 9f1f699a7a3830215f4d5f6da654b4532b4f39f0 · change / sglang

"vscode:/vscode.git/clone" did not exist on "dd6ec02965254291b7bf2c1a90f5eb9a5a5051d4"

13 Oct, 2025 30 commits
- [CI] Add Basic Test for DeepSeek V3.2 (#11308) · 9f1f699a
  Baizhou Zhang authored Oct 13, 2025
  
  9f1f699a
- Fix DeepSeek-v3.2 default config (ValueError: not enough values to unpack... · c9cff2b9
  Trevor Morris authored Oct 13, 2025
```
Fix DeepSeek-v3.2 default config (ValueError: not enough values to unpack (expected 4, got 3)) (#11557)
```
  c9cff2b9
- Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441) · b6fb5d76
  Scott Lee authored Oct 13, 2025
  
  b6fb5d76
- [router] Add Rust CLI flags for queue size, timeout, and rate limit for token... · f4aa7880
  Jonah Bernard authored Oct 13, 2025
```
[router] Add Rust CLI flags for queue size, timeout, and rate limit for token bucket rate limiter (#11483)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  f4aa7880
- Minor: improve sampler & remove unused fields from model_config.py (#11531) · 5e3f7e7f
  Lianmin Zheng authored Oct 13, 2025
  
  5e3f7e7f
- [router] allow user to specify chat template path (#11549) · 728af887
  Simo Lin authored Oct 13, 2025
  
  728af887
- [router][grpc] Further delegate non-stream processing to `processing.rs` (#11553) · 7b59b0b8
  Chang Su authored Oct 13, 2025
  
  7b59b0b8
- Move deep gemm related arguments to `sglang.srt.environ` (#11547) · acc2327b
  Liangsheng Yin authored Oct 14, 2025
  
  acc2327b
- Adjust overlap event loop (#11507) · bfadb5ea
  Liangsheng Yin authored Oct 14, 2025
  
  bfadb5ea
- [router][Fix] Include grpc reflection runtime dependency (#11419) · 9cc1e065
  ai-jz authored Oct 13, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  9cc1e065
- [NVIDIA] BUMP FA3 (#11444) · b8c430f1
  Johnny authored Oct 13, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
```
  b8c430f1
- fix: fix video input for qwen3-vl (#11442) · f35f120d
  Mick authored Oct 14, 2025
  
  f35f120d
- Remove `tp_worker.worker` (#11548) · 54a46a26
  Liangsheng Yin authored Oct 13, 2025
  
  54a46a26
- [router] allow tokenizer path to be dir (#11530) · 7c94eaee
  Simo Lin authored Oct 13, 2025
  
  7c94eaee
- [router][ci] Add Nightly Release Workflow for SGLang Router (#11527) · 13d596c9
  Simo Lin authored Oct 13, 2025
  
  13d596c9
- [Fix] Add per_channel_quant parameter to MoE config functions (#11201) · c7867b67
  Mohammad Miadh Angkad authored Oct 13, 2025
  
  c7867b67
- Depreate `global_server_args_dict` (#11528) · 516738b0
  Liangsheng Yin authored Oct 13, 2025
  
  516738b0
- [Reland] perf: optimize qwen-vl with symm mem allreduce (#11457) · 0b6f535f
  Yuan Luo authored Oct 13, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  0b6f535f
- Tiny fix test run estimated time (#11544) · c5fe3c0b
  Shangming Cai authored Oct 13, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  c5fe3c0b
- [HICache]: Support 3FS-Store with page_first_direct layout (#11460) · 318424e2
  hzh0425 authored Oct 13, 2025
  
  318424e2
- [CI monitor] Improve CI analyzer: fix job failure tracking and add CUDA-focused filtering (#11505) · 6806c4e6
  Xiaoyu Zhang authored Oct 13, 2025
  
  6806c4e6
- ci: improve nightly-ci (#11385) · 0c0779d6
  Mick authored Oct 13, 2025
  
  0c0779d6
- [Feature] Support mamba radix cache v0 (#11214) · a55cf530
  Yi Zhang authored Oct 13, 2025
```
Co-authored-by: hanming-lu <hanming@x.ai>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: thalahors <ericalcaide1@gmail.com>
```
  a55cf530
- [Fix]: add missing device attribute to ChunkCache (#11493) · 19ba16aa
  Yuanhang Sun authored Oct 13, 2025
  
  19ba16aa
- Update DeepSeek-R1-FP4 default config on blackwell (#11512) · a2b3d9b9
  Qiaolin Yu authored Oct 12, 2025
  
  a2b3d9b9
- [sgl-kernel][1/N]Support Expert Specialization Grouped GEMM (#11432) · 9a30914e
  Qi Yuhang authored Oct 13, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: PGFLMG <1106310035@qq.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
```
  9a30914e
- docs(router): add token-bucket rate limiting to the docs (#11485) · 8e776c78
  Jonah Bernard authored Oct 12, 2025
  
  8e776c78
- [router] openai router: support grok model (#11511) · 63e84352
  Keyang Ru authored Oct 12, 2025
  
  63e84352
- Improve dp attention port assignment scheme (#5889) · a20e7df8
  Yongtong Wu authored Oct 13, 2025
```
Co-authored-by: Cheng Wan <cwan@x.ai>
```
  a20e7df8
- Revert "Deprecate `global_server_args_dict`" (#11520) · 1bdd0102
  Cheng Wan authored Oct 12, 2025
  
  1bdd0102
12 Oct, 2025 10 commits
- [lint] Fix the lint issue (#11516) · 6cd29694
  Cheng Wan authored Oct 12, 2025
  
  6cd29694
- Sync changes on io_struct.py and deterministic ops (#11498) · 2ac46e94
  Lianmin Zheng authored Oct 12, 2025
  
  2ac46e94
- [Fix] Improve longbench prompt and other logics (#11474) · 0aa65f94
  Binyao Jiang authored Oct 12, 2025
  
  0aa65f94
- fix: revert temporarily remove b200 tests (#11515) · 0ecb4261
  Yineng Zhang authored Oct 12, 2025
  
  0ecb4261
- chore: remove flashinfer cleanup cache (#11514) · 05f015f6
  Yineng Zhang authored Oct 12, 2025
  
  05f015f6
- Deprecate `global_server_args_dict` (#11331) · 1083e7e3
  Liangsheng Yin authored Oct 13, 2025
  
  1083e7e3
- [CI] fix lint (#11509) · 2157d12a
  Liangsheng Yin authored Oct 13, 2025
  
  2157d12a
- doc: add doc for adding new models into nightly-ci (#11443) · 9f2b457c
  Mick authored Oct 12, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  9f2b457c
- Bugfix: Fix Type consistency for KV indices in SWARadixCache (#11452) · f5b34a51
  hzh0425 authored Oct 12, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  f5b34a51
- Fix unit tests (#11503) · 5a6ec8f9
  Lianmin Zheng authored Oct 12, 2025
  
  5a6ec8f9