Commits · 8374a96e49595fa2330c1d1e15a0b73cb175b751 · change / sglang · GitLab

21 Oct, 2025 10 commits
- piecewise cuda graph support qwen3-moe (#11845) · 8374a96e
  Xiaoyu Zhang authored Oct 21, 2025
  
  8374a96e
- Revise MRotaryEmbedding's forward (#11859) · 74de76c6
  Yuan Luo authored Oct 21, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: 羽癫 <yudian.zy@antgroup.com>
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
```
  74de76c6
- [router][grpc] Fix wram-up random token ids for small models (#11887) · 9c0b1eb5
  Chang Su authored Oct 20, 2025
  
  9c0b1eb5
- [code move] move pp into a separate mixin (#11838) · 01f14a7a
  Lianmin Zheng authored Oct 20, 2025
  
  01f14a7a
- [router] clean up workflow logs to debug for implementation details logs (#11886) · 11110303
  Simo Lin authored Oct 20, 2025
  
  11110303
- fix(sql-router): fix conflict port in test (#11826) · 28ddfb37
  Tien Nguyen authored Oct 21, 2025
```
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  28ddfb37
- [router][grpc] Remove `continue_final_message` in `ChatTemplateParams` and add... · e69094df
  Chang Su authored Oct 20, 2025
```
[router][grpc] Remove `continue_final_message` in `ChatTemplateParams` and add `minijinja-contrib` (#11882)
```
  e69094df
- [Auto Sync] Update scheduler.py, server_args.py (20251020) (#11875) · 43ad0590
  Lianmin Zheng authored Oct 20, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  43ad0590
- [router] remove encoding header for oai router (#11881) · b4948512
  Simo Lin authored Oct 20, 2025
  
  b4948512
- [router] Worker Management Workflow Engine (#11868) · ddcba74b
  Simo Lin authored Oct 20, 2025
  
  ddcba74b
20 Oct, 2025 28 commits
- Support mixing cutedsl and deepgemm backend (#11807) · 0917c5da
  fzyzcjy authored Oct 21, 2025
  
  0917c5da
- Replace function call with set literal (#11867) · 184a4df6
  penguin_wwy authored Oct 21, 2025
  
  184a4df6
- Fix acc len and gen throughput metrics when enabling overlap-spec (#11823) · f7b1d8c5
  Qiaolin Yu authored Oct 20, 2025
```
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
```
  f7b1d8c5
- [9/N] MoE Refactor: cleanup dispatcher interfaces (#11847) · bfc3b3f7
  Cheng Wan authored Oct 20, 2025
  
  bfc3b3f7
- Tiny fix main lint (#11862) · da5bde4d
  Liangsheng Yin authored Oct 20, 2025
  
  da5bde4d
- [Feature] New structural tag support (#10691) · 276e7b3e
  DarkSharpness authored Oct 20, 2025
  
  276e7b3e
- fix(server_args): handle tokenizer init conflicts (#11776) · 296f6892
  ishandhanani authored Oct 20, 2025
  
  296f6892
- [AMD CI] Populate image cache in nightly docker release. (#11822) · 9edb7b51
  Sai Enduri authored Oct 20, 2025
  
  9edb7b51
- Update amd gpu install docs. (#11849) · e53bf442
  Sai Enduri authored Oct 20, 2025
  
  e53bf442
- [Model] Add Olmo 3 model support (#11396) · d383e661
  Shane A authored Oct 19, 2025
  
  d383e661
- Revert "[CI Monitor] Ci monitor only deal with main branch in default" (#11846) · 984fbeb1
  Xiaoyu Zhang authored Oct 20, 2025
  
  984fbeb1
- Tiny clean up for PD module and doc (#11747) · a2ba0bc3
  Shangming Cai authored Oct 20, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  a2ba0bc3
- [PD] Improve eagle acceptance rate by transferring draft model hidden states (#10801) · 6d2d0ce2
  Ziming Huang authored Oct 20, 2025
```
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  6d2d0ce2
- Support mrope triton kernel and add unit test (#11722) · 271d3d0d
  Yuan Luo authored Oct 20, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
```
  271d3d0d
- [Feature] Use current greenctx stream to communicate in PD-Multiplexing. (#11594) · c4e81e64
  ykcombat authored Oct 20, 2025
  
  c4e81e64
- Recapture cuda graph after model weight update to resolve IMA error (#11780) · c726d44c
  harrisonlimh authored Oct 19, 2025
  
  c726d44c
- chore: bump sgl-kernel version to 0.3.16.post3 (#11733) · 283c8ba0
  sglang-bot authored Oct 19, 2025
  
  283c8ba0
- check master server for mooncake store (#10510) · cae39565
  huangtingwei authored Oct 20, 2025
  
  cae39565
- Improve Kernel Build Time (#11508) · 27a223ab
  Kangyan-Zhou authored Oct 19, 2025
  
  27a223ab
- Fix version bump script to handle TOML files with outdated versions (#11787) · 53529f46
  Kangyan-Zhou authored Oct 19, 2025
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  53529f46
- fix(ci): Fix CI Monitor limit parameter and add CI Analysis to summary (#11832) · 24ed3f32
  Xiaoyu Zhang authored Oct 20, 2025
  
  24ed3f32
- [Doc] Update documents for FA4 (#11778) · 44f0ece9
  Baizhou Zhang authored Oct 19, 2025
  
  44f0ece9
- [BugFix] replace the input_to_float8 used in dsv2 (#11612) · be0058bc
  Liu-congo authored Oct 20, 2025
```
Signed-off-by: Liu-congo <1502632128@qq.com>
```
  be0058bc
- Tiny bump DeepEP version in ARM blackwell (#11810) · 9e3be1fa
  fzyzcjy authored Oct 20, 2025
  
  9e3be1fa
- Fix triton_kernels import error on some hardwares (#11831) · a8ba3279
  fzyzcjy authored Oct 20, 2025
  
  a8ba3279
- [DeepseekV32] Add fast_topk_transform_ragged_fused kernel (#11815) · 3b80232d
  hlu1 authored Oct 19, 2025
```
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
```
  3b80232d
- [NVIDIA] FA3/FA4 Fix (#11606) · 252dc4e1
  Johnny authored Oct 20, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  252dc4e1
- [CI] Add CI test for DeepSeek V3.2 MTP (#11835) · cbb5fc2e
  Baizhou Zhang authored Oct 19, 2025
  
  cbb5fc2e
19 Oct, 2025 2 commits
- [logprobs] Enable local deterministic logrprobs testing with strict threshold (#10994) · 53fb229f
  Night authored Oct 19, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  53fb229f
- Deterministic Mode: Add 1-stage triton kernel for prefill (#11147) · 4fff1ec1
  Stefan He authored Oct 19, 2025
```
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Binyao Jiang <bijiang@linkedin.com>
```
  4fff1ec1