Commits · cb8f3d90d33f8d3c54d459f9e661922c75212e9c · change / sglang · GitLab

13 Oct, 2025 19 commits
- [NVIDIA] update pyproject.toml to support cu130 option (#11521) · cb8f3d90
  Johnny authored Oct 13, 2025
  
  cb8f3d90
- Fix DeepSeek-v3.2 default config (ValueError: not enough values to unpack... · c9cff2b9
  Trevor Morris authored Oct 13, 2025
```
Fix DeepSeek-v3.2 default config (ValueError: not enough values to unpack (expected 4, got 3)) (#11557)
```
  c9cff2b9
- Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441) · b6fb5d76
  Scott Lee authored Oct 13, 2025
  
  b6fb5d76
- Minor: improve sampler & remove unused fields from model_config.py (#11531) · 5e3f7e7f
  Lianmin Zheng authored Oct 13, 2025
  
  5e3f7e7f
- Move deep gemm related arguments to `sglang.srt.environ` (#11547) · acc2327b
  Liangsheng Yin authored Oct 14, 2025
  
  acc2327b
- Adjust overlap event loop (#11507) · bfadb5ea
  Liangsheng Yin authored Oct 14, 2025
  
  bfadb5ea
- [router][Fix] Include grpc reflection runtime dependency (#11419) · 9cc1e065
  ai-jz authored Oct 13, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  9cc1e065
- fix: fix video input for qwen3-vl (#11442) · f35f120d
  Mick authored Oct 14, 2025
  
  f35f120d
- Remove `tp_worker.worker` (#11548) · 54a46a26
  Liangsheng Yin authored Oct 13, 2025
  
  54a46a26
- [Fix] Add per_channel_quant parameter to MoE config functions (#11201) · c7867b67
  Mohammad Miadh Angkad authored Oct 13, 2025
  
  c7867b67
- Depreate `global_server_args_dict` (#11528) · 516738b0
  Liangsheng Yin authored Oct 13, 2025
  
  516738b0
- [Reland] perf: optimize qwen-vl with symm mem allreduce (#11457) · 0b6f535f
  Yuan Luo authored Oct 13, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  0b6f535f
- [HICache]: Support 3FS-Store with page_first_direct layout (#11460) · 318424e2
  hzh0425 authored Oct 13, 2025
  
  318424e2
- ci: improve nightly-ci (#11385) · 0c0779d6
  Mick authored Oct 13, 2025
  
  0c0779d6
- [Feature] Support mamba radix cache v0 (#11214) · a55cf530
  Yi Zhang authored Oct 13, 2025
```
Co-authored-by: hanming-lu <hanming@x.ai>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: thalahors <ericalcaide1@gmail.com>
```
  a55cf530
- [Fix]: add missing device attribute to ChunkCache (#11493) · 19ba16aa
  Yuanhang Sun authored Oct 13, 2025
  
  19ba16aa
- Update DeepSeek-R1-FP4 default config on blackwell (#11512) · a2b3d9b9
  Qiaolin Yu authored Oct 12, 2025
  
  a2b3d9b9
- Improve dp attention port assignment scheme (#5889) · a20e7df8
  Yongtong Wu authored Oct 13, 2025
```
Co-authored-by: Cheng Wan <cwan@x.ai>
```
  a20e7df8
- Revert "Deprecate `global_server_args_dict`" (#11520) · 1bdd0102
  Cheng Wan authored Oct 12, 2025
  
  1bdd0102
12 Oct, 2025 18 commits
- Sync changes on io_struct.py and deterministic ops (#11498) · 2ac46e94
  Lianmin Zheng authored Oct 12, 2025
  
  2ac46e94
- [Fix] Improve longbench prompt and other logics (#11474) · 0aa65f94
  Binyao Jiang authored Oct 12, 2025
  
  0aa65f94
- Deprecate `global_server_args_dict` (#11331) · 1083e7e3
  Liangsheng Yin authored Oct 13, 2025
  
  1083e7e3
- Bugfix: Fix Type consistency for KV indices in SWARadixCache (#11452) · f5b34a51
  hzh0425 authored Oct 12, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  f5b34a51
- Fix port conflicts in CI (#11497) · 548a57b1
  Lianmin Zheng authored Oct 12, 2025
  
  548a57b1
- move fla env check position (#11500) · 4b15fa00
  Yi Zhang authored Oct 12, 2025
  
  4b15fa00
- Move args from `global_config` to `environ` (#11332) · f4941906
  Liangsheng Yin authored Oct 12, 2025
  
  f4941906
- Fix CI break by express-laned PRs. (#11499) · 01e59e82
  Liangsheng Yin authored Oct 12, 2025
  
  01e59e82
- bailingMoE: Fix Key error of deepep_mode (#11465) · 99a0704a
  Mike Qiu authored Oct 12, 2025
```
Signed-off-by: Michael Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: Mike_Qiu <qiudayu.qdy@antgroup.com>
```
  99a0704a
- Fix the GPT function calling regex to allow dash in the name (#10577) · ec1cd90a
  Antoine Roux authored Oct 12, 2025
  
  ec1cd90a
- [chore][2/N] Avoid using default mutable parameters (#11479) · 1103dc62
  Kai-Hsun Chen authored Oct 12, 2025
```
Signed-off-by: Kai-Hsun Chen <khchen@x.ai>
```
  1103dc62
- [ perf ] Replace json-> orjson in hot path (#11221) · a220536f
  Vincent Zhong authored Oct 12, 2025
```
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
```
  a220536f
- [bugfix]: use correct causality condition for flashattention, flashinfer, and... · 7b064f04
  Mahmoud Ashraf authored Oct 12, 2025
```
[bugfix]: use correct causality condition for flashattention, flashinfer, and triton backends (#10172)
```
  7b064f04
- [chore][1/N] Avoid using default mutable parameters (#11478) · 43190bec
  Kai-Hsun Chen authored Oct 12, 2025
```
Signed-off-by: Kai-Hsun Chen <khchen@x.ai>
```
  43190bec
- [smol] [perf] Qwen3-VL in place op. (#11481) · be740acd
  Vincent Zhong authored Oct 12, 2025
```
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
```
  be740acd
- Piecewise CUDA Graph Support & Torch Compile Backend (#10062) · 4ac8e09d
  Yuwei An authored Oct 11, 2025
```
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
```
  4ac8e09d
- Beta spec-overlap for EAGLE (#11398) · 20a6c0a6
  Liangsheng Yin authored Oct 12, 2025
```
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  20a6c0a6
- [Feature] support regex strings as a stopping condition (#10635) · 47c606d3
  Glen Liu authored Oct 11, 2025
  
  47c606d3
11 Oct, 2025 3 commits
- Add option to disable `any_whitespace` for `xgrammar` and `llguidance` backends. (#8919) · b5dcfd41
  Lorenzo Lu authored Oct 11, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  b5dcfd41
- fix stop when stream (#11462) · 5061b8fd
  ybyang authored Oct 11, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
```
  5061b8fd
- [Fix] Fix split prefill with fa3. (#11428) · c8452551
  ykcombat authored Oct 11, 2025
  
  c8452551