Commits · eb19ccadae4b7ff8f2cd5187ba194a87b2bdcddc · zhaoyu6 / sglang · GitLab

21 Aug, 2025 4 commits
- [bug] fix errors related to context length in SD (#9388) · eb19ccad
  Liangsheng Yin authored Aug 21, 2025
  
  eb19ccad
- [PD] Fix nvlink transport accuracy through transferring metadata with tcp (#9261) · 25ef53f0
  Shangming Cai authored Aug 21, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  25ef53f0
- Fix biased_grouped_topk_cpu (#9420) · c674bf9c
  Cao E authored Aug 21, 2025
  
  c674bf9c
- Fix max_seq_len_k in trtllm_mha attention backend (#9416) · af1973b8
  Qiaolin Yu authored Aug 20, 2025
  
  af1973b8
20 Aug, 2025 19 commits
- Support trtllm_allreduce_fusion in flashinfer for cuda<12.8 (#9339) · 88fbc31b
  strgrb authored Aug 21, 2025
```
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
```
  88fbc31b
- Add support for Qwen3-seq-cls (#9357) · 8f5b9910
  nathan authored Aug 21, 2025
  
  8f5b9910
- fix: InternS1 don't recognize image, updates image token for InternVL processor (#9381) · 84719b52
  Xinyuan Tong authored Aug 21, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  84719b52
- Fixed the issue where eagle3 TPOT was not as good as without eagle3. (#9404) · e99729c9
  jiapingW authored Aug 21, 2025
  
  e99729c9
- Support DP attention with GPT-OSS (#9359) · c10b8e6a
  Nicolas Castet authored Aug 20, 2025
  
  c10b8e6a
- Fix incorrect logic in chat template handling. (#9336) · d4bce297
  Lifu Huang authored Aug 20, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  d4bce297
- Support pinning adapter via server args. (#9249) · b0980af8
  Lifu Huang authored Aug 20, 2025
  
  b0980af8
- Fix FlashInfer GPU <-> CPU sync (#9409) · 24eaebeb
  Nathan Wang authored Aug 20, 2025
  
  24eaebeb
- [2/2] Fuse routed scaling factor into select_experts (#8690) · a91e90d9
  Trevor Morris authored Aug 20, 2025
  
  a91e90d9
- Refactor allreduce add rmsnorm pattern (#9278) · f96413c4
  Xiaoyu Zhang authored Aug 20, 2025
  
  f96413c4
- Fix the `--allow-auto-truncate` argument in tokenizer manager. (#9391) · 08ebdf79
  Liangsheng Yin authored Aug 20, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  08ebdf79
- Add PDL support for quant kernel and rope kernel (#9106) · 42c87045
  fzyzcjy authored Aug 20, 2025
  
  42c87045
- Revert "[feature] Rework Ascend NPU graph support" (#9385) · de2dd738
  Even Zhou authored Aug 20, 2025
  
  de2dd738
- [Docs] Update contribution guide (#9383) · 1ec97697
  Lianmin Zheng authored Aug 19, 2025
  
  1ec97697
- [minor] Sync style changes (#9376) · f20b6a3f
  Lianmin Zheng authored Aug 19, 2025
  
  f20b6a3f
- [feature] Rework Ascend NPU graph support (#9350) · 3680d6f8
  Even Zhou authored Aug 20, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>
```
  3680d6f8
- Fix gpt-oss response api streaming issue (#9368) · f5154495
  Keyang Ru authored Aug 19, 2025
  
  f5154495
- Fix triton backend eagle illegal memory access (#9344) · e0ce171d
  Ke Bao authored Aug 20, 2025
  
  e0ce171d
- Fix mini lb timeout issue (#9369) · fe43e889
  fzyzcjy authored Aug 20, 2025
  
  fe43e889
19 Aug, 2025 5 commits
- Revert "[feature] Ascend NPU graph support (#8027)" (#9348) · f4fafacc
  Even Zhou authored Aug 20, 2025
  
  f4fafacc
- [Bugfix] fix kv buffer register & dp attention & deepepmoe (#9327) · 01d47a27
  chenxu140 authored Aug 20, 2025
  
  01d47a27
- enable marlin fp8 blockwise (#8990) · e483ab6d
  Enrique Shockwave authored Aug 19, 2025
  
  e483ab6d
- [Bug] Fix input arguments of flashinfer_trtllm_moe (#9317) · 3c2c9f6c
  Jiaqi Gu authored Aug 18, 2025
  
  3c2c9f6c
- support for interns1-mini (#9299) · a31ea448
  zxy authored Aug 19, 2025
  
  a31ea448
18 Aug, 2025 11 commits
- Tiny fix CI (#9306) · 5626e20b
  fzyzcjy authored Aug 19, 2025
  
  5626e20b
- [GLM4.1V and GLM4.5V] Add vision transformer num_dummy_head support: max tp=4 -> max tp=8 (#9059) · c2fbf60f
  Binyao Jiang authored Aug 18, 2025
  
  c2fbf60f
- [PD] Propagate internal server errors from aborted requests to clients instead... · 98b44e9e
  datdo-msft authored Aug 18, 2025
```
[PD] Propagate internal server errors from aborted requests to clients instead of blindly returning 200's (#8936)
```
  98b44e9e
- upgrade xgrammar 0.1.23 and openai-harmony 0.0.4 (#9284) · 6805f6da
  Swipe4057 authored Aug 19, 2025
  
  6805f6da
- [Docs] Correct and clarify notes in Engine docstring (#9313) · ca533580
  江家瑋 authored Aug 19, 2025
```
Signed-off-by: JiangJiaWei1103 <waynechuang97@gmail.com>
```
  ca533580
- [MISC] use dynamic choices for tool-call-parser argument (#9316) · 886454e8
  Keyang Ru authored Aug 18, 2025
  
  886454e8
- should return invalide request for empty prompt (#9315) · 0cf3fbeb
  gongwei-130 authored Aug 18, 2025
  
  0cf3fbeb
- Modelopt quant config adaptation (#8829) · 2256d62d
  Zhiyu authored Aug 18, 2025
  
  2256d62d
- Minor style fixes for sgl-kernel (#9289) · c480a3f6
  Lianmin Zheng authored Aug 18, 2025
  
  c480a3f6
- Further fix memory pool leak error (#9298) · 4c0bb411
  fzyzcjy authored Aug 18, 2025
  
  4c0bb411
- [Fix] Add undefined `update_tensor_inplace` function (#6307) · 716e6827
  b8zhong authored Aug 17, 2025
  
  716e6827
17 Aug, 2025 1 commit
- Set the default attention backend for GLM-4.5v to fa3 (#9245) · 84b30d9e
  zifeitong authored Aug 17, 2025
  
  84b30d9e