Commits · 1237aa19ce63a35b623c43b76e8b8b093499f3cd · change / sglang · GitLab

30 Sep, 2025 10 commits
- [Auto Sync] Update fused_moe_triton_config.py (20250930) (#11099) · 1237aa19
  Lianmin Zheng authored Sep 30, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  1237aa19
- [Fix] Resolve performance drop in speculative decoding aiter backend (#11087) · 59911195
  jacky.cheng authored Sep 30, 2025
  
  59911195
- Fix spec filter batch when target extend (#10991) · 424591d5
  Ke Bao authored Sep 30, 2025
  
  424591d5
- [router][tool call] Full support for ToolChoice (#11085) · d1676cd4
  Chang Su authored Sep 29, 2025
```
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  d1676cd4
- [router] grpc router generate endpoint support (#11070) · 33b3c0f8
  Simo Lin authored Sep 30, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  33b3c0f8
- Update CODEOWNERS for attention/ascend_backend.py (#11092) · e5281f84
  Lianmin Zheng authored Sep 29, 2025
  
  e5281f84
- Enable optional FP32 compute for LM Head (#10729) · d17986f8
  narutolhy authored Sep 29, 2025
```
Thanks to MiniMax Team and Chenyang Zhao's support.
```
  d17986f8
- [model] added support for w8a8int8 used by neuralmagic/Qwen2-0.5B-Ins… (#9642) · 8831c55c
  DevashishLal-CB authored Sep 29, 2025
  
  8831c55c
- Remove hybrid_linear_attn attention backend and refactor attention registry (#10816) · 2bc61dd1
  li-kesen authored Sep 30, 2025
```
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  2bc61dd1
- [Profile] dump memory trace when cuda graph profile is enabled (#11083) · 6535fda1
  Cheng Wan authored Sep 29, 2025
  
  6535fda1
29 Sep, 2025 21 commits
- feat(reasoning): improve enable thinking from request (#10875) · 3713eb61
  Jimmy authored Sep 30, 2025
  
  3713eb61
- [router][grpc] Add logprobs support to router (#11082) · 5937a56d
  Chang Su authored Sep 29, 2025
  
  5937a56d
- [router] Use `get_pooled` in `process_single_choice` (#11079) · f065e5be
  Chang Su authored Sep 29, 2025
  
  f065e5be
- fix: fp8 mllama4 without vision modules being quantized (#10611) · 9de1320b
  Mick authored Sep 30, 2025
  
  9de1320b
- Fix mem fraction static for nightly tests (#11076) · dda34c2f
  Lianmin Zheng authored Sep 29, 2025
  
  dda34c2f
- [router][tool call] Separate `JsonParser` and `LlamaParser` (#11073) · 4eeaff74
  Chang Su authored Sep 29, 2025
  
  4eeaff74
- Use more general heuristics to set the default value of --mem-fraction-static (#10975) · a17e70f5
  Lianmin Zheng authored Sep 29, 2025
```
Co-authored-by: sglang-bot <sglangbot@gmail.com>
```
  a17e70f5
- [router] add n to generate sampling params (#11069) · 816b3a43
  Simo Lin authored Sep 29, 2025
  
  816b3a43
- chore: upgrade sgl-kernel 0.3.13 (#11056) · 3a641d90
  Yineng Zhang authored Sep 29, 2025
  
  3a641d90
- [Ci Monitor] Auto uploaded performance data to sglang_ci_data repo (#10976) · 6f16bf9d
  Xiaoyu Zhang authored Sep 29, 2025
  
  6f16bf9d
- chore: upgrade cutedsl 4.2.1 (#11054) · 5942fdb4
  Yineng Zhang authored Sep 29, 2025
  
  5942fdb4
- [router][tool call] Improve normal content extraction and error handling (non-stream) (#11050) · af4ab656
  Chang Su authored Sep 29, 2025
  
  af4ab656
- Fix sgl-kernel benchmark dead code (#11022) · 11965b0d
  Xiaoyu Zhang authored Sep 29, 2025
  
  11965b0d
- Fix gemma 3 launch with `transformers:` the error: `AttributeError:... · 71959545
  Vincent Zhong authored Sep 29, 2025
```
Fix gemma 3 launch with `transformers:` the error: `AttributeError: 'TransformersForCausalLM' object has no attribute 'tp_size'` (#9614)
```
  71959545
- [speculative decoding] rename lookahead to ngram (#11010) · 24f7cb1e
  Zhihao Zhang authored Sep 29, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
```
  24f7cb1e
- [HiCacheStorage] mooncake store support page_first_direct layout (#10591) · e05555fa
  huangtingwei authored Sep 29, 2025
  
  e05555fa
- fix: check if weights are already local before downloading (#11015) · 43fa9f22
  Mick authored Sep 29, 2025
  
  43fa9f22
- [1/2] Support FA4 for MHA Prefill in sgl-kernel (#10940) · e98d9346
  Lifu Huang authored Sep 28, 2025
  
  e98d9346
- Unify SGL Kernel Releases (#10701) · 0c917410
  Kangyan-Zhou authored Sep 28, 2025
  
  0c917410
- [router] add harmony tool parser base structure and interface (#11036) · 25728863
  Simo Lin authored Sep 28, 2025
  
  25728863
- [router][tool call] Support normal content extraction before tool call (streaming) (#11038) · dba751a8
  Chang Su authored Sep 28, 2025
  
  dba751a8
28 Sep, 2025 9 commits
- fix: show failed models in nightly ci (#10986) · 2e763398
  Mick authored Sep 29, 2025
  
  2e763398
- [router] migrate to rust python module for pythonic parser (#11033) · 336e9a60
  Simo Lin authored Sep 28, 2025
  
  336e9a60
- Update GLM-4.5 Model Doc (#11017) · abb67815
  Yuxuan Zhang authored Sep 29, 2025
  
  abb67815
- Fix FusedSetKVBufferArg in RotaryEmbedding (#11003) · 07440f5f
  Lianmin Zheng authored Sep 28, 2025
  
  07440f5f
- [HiCache] bug: fix mooncake store batch set v1 (#11013) · 9816989b
  Teng Ma authored Sep 28, 2025
  
  9816989b
- [sgl-kernel] Optimize concat_mla_k kernel (#10543) · 42245551
  Yuan Luo authored Sep 28, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: PGFLMG <1106310035@qq.com>
```
  42245551
- prepare for sglang+verl (#10555) · 2a9d995c
  lbk-sys authored Sep 28, 2025
```
Signed-off-by: lbk-sys <hello_lbk@163.com>
Signed-off-by: libaokui <libaokui@hauwei.com>
Co-authored-by: libaokui <libaokui@hauwei.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
```
  2a9d995c
- [bugfix]Add empty_context import to two_batch_overlap.py (#10964) · a9050b5c
  wejoncy authored Sep 28, 2025
  
  a9050b5c
- Fix CI failure of TypeError: RotaryEmbedding.forward_cpu() got an unexpected... · 66face35
  YanbingJiang authored Sep 28, 2025
```
Fix CI failure of TypeError: RotaryEmbedding.forward_cpu() got an unexpected keyword argument 'fused_set_kv_buffer_arg' (#11009)
```
  66face35