Commits · e65231022fad5338bb1a598db7bf5f0be3c56147 · change / sglang · GitLab

21 Aug, 2025 2 commits
- [router] add tokenizer integration test with real mini tokenizer (#9413) · e6523102
  Chang Su authored Aug 20, 2025
  
  e6523102
- [router] Add IGW (Inference Gateway) Feature Flag (#9371) · 3828db43
  Keyang Ru authored Aug 20, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  3828db43
20 Aug, 2025 25 commits
- Support trtllm_allreduce_fusion in flashinfer for cuda<12.8 (#9339) · 88fbc31b
  strgrb authored Aug 21, 2025
```
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
```
  88fbc31b
- Add support for Qwen3-seq-cls (#9357) · 8f5b9910
  nathan authored Aug 21, 2025
  
  8f5b9910
- misc: parse bench_serving result as markdown table (#9377) · ef3004d9
  Mick authored Aug 21, 2025
  
  ef3004d9
- fix: InternS1 don't recognize image, updates image token for InternVL processor (#9381) · 84719b52
  Xinyuan Tong authored Aug 21, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  84719b52
- Fixed the issue where eagle3 TPOT was not as good as without eagle3. (#9404) · e99729c9
  jiapingW authored Aug 21, 2025
  
  e99729c9
- Support DP attention with GPT-OSS (#9359) · c10b8e6a
  Nicolas Castet authored Aug 20, 2025
  
  c10b8e6a
- Fix incorrect logic in chat template handling. (#9336) · d4bce297
  Lifu Huang authored Aug 20, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  d4bce297
- Support pinning adapter via server args. (#9249) · b0980af8
  Lifu Huang authored Aug 20, 2025
  
  b0980af8
- Fix FlashInfer GPU <-> CPU sync (#9409) · 24eaebeb
  Nathan Wang authored Aug 20, 2025
  
  24eaebeb
- [2/2] Fuse routed scaling factor into select_experts (#8690) · a91e90d9
  Trevor Morris authored Aug 20, 2025
  
  a91e90d9
- Refactor allreduce add rmsnorm pattern (#9278) · f96413c4
  Xiaoyu Zhang authored Aug 20, 2025
  
  f96413c4
- Fix the `--allow-auto-truncate` argument in tokenizer manager. (#9391) · 08ebdf79
  Liangsheng Yin authored Aug 20, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  08ebdf79
- Add PDL support for quant kernel and rope kernel (#9106) · 42c87045
  fzyzcjy authored Aug 20, 2025
  
  42c87045
- Reduce overhead for fa by not calling heavy CUDA property check (#7375) · c9bf3877
  Yichen Yan authored Aug 20, 2025
  
  c9bf3877
- Revert "[feature] Rework Ascend NPU graph support" (#9385) · de2dd738
  Even Zhou authored Aug 20, 2025
  
  de2dd738
- [Docs] Update contribution guide (#9383) · 1ec97697
  Lianmin Zheng authored Aug 19, 2025
  
  1ec97697
- [CI] Fix disaggregation failure tolerance CI (#9378) · d8ed60f2
  Shangming Cai authored Aug 20, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  d8ed60f2
- [readme] Add SGLang x AMD SF meetup information (#9380) · f1b0eda5
  Mingyi authored Aug 19, 2025
  
  f1b0eda5
- [minor] Sync style changes (#9376) · f20b6a3f
  Lianmin Zheng authored Aug 19, 2025
  
  f20b6a3f
- [feature] Rework Ascend NPU graph support (#9350) · 3680d6f8
  Even Zhou authored Aug 20, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>
```
  3680d6f8
- Fix gpt-oss response api streaming issue (#9368) · f5154495
  Keyang Ru authored Aug 19, 2025
  
  f5154495
- Fix triton backend eagle illegal memory access (#9344) · e0ce171d
  Ke Bao authored Aug 20, 2025
  
  e0ce171d
- Fix mini lb timeout issue (#9369) · fe43e889
  fzyzcjy authored Aug 20, 2025
  
  fe43e889
- [router] Implement OpenAI Responses API specification (#9367) · 5ae5ecaa
  Keyang Ru authored Aug 19, 2025
  
  5ae5ecaa
- [router] add tokenizer chat template support (#9370) · 5fbad308
  Simo Lin authored Aug 19, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  5fbad308
19 Aug, 2025 13 commits
- [router] Implement gRPC SGLangSchedulerClient (#9364) · 7638f5e4
  Chang Su authored Aug 19, 2025
  
  7638f5e4
- [router] adds reasoning parser pooling and thread-safe (#9360) · b45f753c
  Simo Lin authored Aug 19, 2025
  
  b45f753c
- [Router] Add validation module for API parameters (#9335) · c5057262
  Keyang Ru authored Aug 19, 2025
  
  c5057262
- [CI] Fix lint issues (#9361) · 46fe8b8c
  Chang Su authored Aug 19, 2025
  
  46fe8b8c
- [router] add tiktokenizer and sequence in router (#9354) · 0b95a01a
  Simo Lin authored Aug 19, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  0b95a01a
- fix: enable multi-GPU Triton fused MoE tuning (#6295) · a3b810eb
  mpashkovskiy authored Aug 19, 2025
  
  a3b810eb
- [router] add dsr1, kimi, and qwen reasoning parser (#9353) · 94959237
  Simo Lin authored Aug 19, 2025
  
  94959237
- Revert "[feature] Ascend NPU graph support (#8027)" (#9348) · f4fafacc
  Even Zhou authored Aug 20, 2025
  
  f4fafacc
- [Bugfix] fix kv buffer register & dp attention & deepepmoe (#9327) · 01d47a27
  chenxu140 authored Aug 20, 2025
  
  01d47a27
- [Minor] Fix the style of sgl-kernel (#9332) · ecc9f3e4
  Lianmin Zheng authored Aug 18, 2025
  
  ecc9f3e4
- docs: fix spec (#9326) · 7e8187e0
  Yineng Zhang authored Aug 18, 2025
  
  7e8187e0
- enable marlin fp8 blockwise (#8990) · e483ab6d
  Enrique Shockwave authored Aug 19, 2025
  
  e483ab6d
- Add `CMakeLists.txt` binary_dir (#7019) · 720cd308
  EduardDurech authored Aug 19, 2025
  
  720cd308