Commits · b32ab0705edb8401d93b47e28dc5fc4d37b2e39b · change / sglang

04 Sep, 2025 3 commits
- metrics: support customer buckets for prompt/generation_tokens_histogram (#9634) · b32ab070
  Yingchun Lai authored Sep 04, 2025
  
  b32ab070
- feat(hicache): Add generic hicache ci e2e test and benchmark test (#9846) · 106c2b31
  hzh0425 authored Sep 04, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  106c2b31
- feat: add gpt oss b200 ci (#9988) · de921733
  Yineng Zhang authored Sep 03, 2025
  
  de921733
03 Sep, 2025 1 commit
- Move parsers under a single folder (#9912) · 60e37f80
  Lianmin Zheng authored Sep 02, 2025
  
  60e37f80
02 Sep, 2025 1 commit

[model] support MiniCPM-V 4.0 (#8747) · 03dbf1aa

tc-mb authored Sep 03, 2025


Signed-off-by: tc-mb <caitianchi@modelbest.cn>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>

03dbf1aa

01 Sep, 2025 2 commits

Support Multi Process Tokenizer Manager(#6555) (#8964) · 5f77e129

ybyang authored Sep 01, 2025


Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>

5f77e129

Disable radix cache in test_lora_update.py for better stability (#9852) · 7de2ce45
Baizhou Zhang authored Aug 31, 2025

7de2ce45

29 Aug, 2025 3 commits
- feat: add original logprobs to response (#8375) · 839c93bd
  narutolhy authored Aug 29, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: luhongyu.4869 <luhongyu.4869@bytedance.com>
```
  839c93bd
- support enable in the reasoning field to enable thingking for thinkin… (#9715) · 3fd1431d
  gongwei-130 authored Aug 29, 2025
  
  3fd1431d
- accomendate json schema in the "schema" field, not in "json_schema" field of... · 9a7c8842
  gongwei-130 authored Aug 28, 2025
```
accomendate json schema in the "schema" field, not in "json_schema" field of response_format (#9786)
```
  9a7c8842
28 Aug, 2025 2 commits
- [AMD] Support Hierarchical Caching on AMD GPUs (#8236) · 711390a9
  Hubert Lu authored Aug 28, 2025
  
  711390a9
- Support speculative decoding in hybrid attention backend (#9573) · 4a4772ae
  Qiaolin Yu authored Aug 28, 2025
  
  4a4772ae
26 Aug, 2025 4 commits
- add `response_format` support for `completion` API (#9665) · b6c14ec0
  cicirori authored Aug 27, 2025
  
  b6c14ec0
- Fix kimi k2 function calling format (#9606) · 0936c766
  Xiaotong Jiang authored Aug 26, 2025
  
  0936c766
- model: Support nvidia/Llama-3_1-Nemotron-Ultra-253B-v1 (#9301) · 4cd08dc5
  Netanel Haber authored Aug 26, 2025
  
  4cd08dc5
- [new feat] ascend backend support fia fusion kernel (#8328) · f92b729d
  ZhengdQin authored Aug 26, 2025
```
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
```
  f92b729d
25 Aug, 2025 2 commits

Fix Harmony reasoning parser for and auto-separation for gpt-oss models (#9190) · a0a77d93

Jonas authored Aug 26, 2025


Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: minleminzui <2969413251@qq.com>
Co-authored-by: maocheng23 <maocheng@berkeley.edu>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

a0a77d93

fix: revert #8593 (#9581) · ebd9dbe7
Yineng Zhang authored Aug 25, 2025

ebd9dbe7

22 Aug, 2025 1 commit
- Add Support for Page Size greater than 1 for Flashinfer MLA Backend (#8593) · 3cc3d9b9
  Pavani Majety authored Aug 21, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  3cc3d9b9
21 Aug, 2025 2 commits

ci: enhance xeon ci (#9395) · 029e0af3
DiweiSun authored Aug 21, 2025

029e0af3

[feature] Ascend NPU graph support (#9399) · 2c4b4b78

VDV1985 authored Aug 21, 2025


Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>

2c4b4b78

20 Aug, 2025 5 commits
- misc: parse bench_serving result as markdown table (#9377) · ef3004d9
  Mick authored Aug 21, 2025
  
  ef3004d9
- Support pinning adapter via server args. (#9249) · b0980af8
  Lifu Huang authored Aug 20, 2025
  
  b0980af8
- Revert "[feature] Rework Ascend NPU graph support" (#9385) · de2dd738
  Even Zhou authored Aug 20, 2025
  
  de2dd738
- [CI] Fix disaggregation failure tolerance CI (#9378) · d8ed60f2
  Shangming Cai authored Aug 20, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  d8ed60f2
- [feature] Rework Ascend NPU graph support (#9350) · 3680d6f8
  Even Zhou authored Aug 20, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>
```
  3680d6f8
19 Aug, 2025 1 commit
- Revert "[feature] Ascend NPU graph support (#8027)" (#9348) · f4fafacc
  Even Zhou authored Aug 20, 2025
  
  f4fafacc
18 Aug, 2025 1 commit
- Fix triton_fused_moe unit test and benchmark (#9276) · 968e1818
  Yuan Luo authored Aug 18, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  968e1818
17 Aug, 2025 6 commits

model: support nvidia/Llama-3_3-Nemotron-Super-49B-v1 (#9067) · 845d12a9
Netanel Haber authored Aug 17, 2025
```
Co-authored-by: Kyle Huang <kylhuang@nvidia.com>
```
845d12a9
Quick Fix GLM (#9264) · e47800e1
Stefan He authored Aug 16, 2025

e47800e1
ci: simplify multi-modality tests by using mixins (#9006) · 1df84ff4
Mick authored Aug 17, 2025

1df84ff4
Bug fix: use correct mm_items in embed_mm_inputs (#8893) · 66d6be08
Binyao Jiang authored Aug 16, 2025

66d6be08

[PD] Support PD disaggregation with Prefill PP (#8846) · 384f8ab5

Shangming Cai authored Aug 17, 2025


Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: root <huzhiyuan@xiaohongshu.com>
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Francis <38564764+ssssnow@users.noreply.github.com>
Co-authored-by: zitto <zhjc1124@gmail.com>

384f8ab5

[feature] Ascend NPU graph support (#8027) · 94371dbb

VDV1985 authored Aug 17, 2025


Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>

94371dbb

16 Aug, 2025 1 commit
- [CI] add deepseek w4a8 test on h20 ci (#7758) · 81da16f6
  Hank Han authored Aug 16, 2025
  
  81da16f6
15 Aug, 2025 2 commits
- [AMD] Expand test coverage for AMD CI and enable... · 9c3e95d9
  Hubert Lu authored Aug 15, 2025
```
[AMD] Expand test coverage for AMD CI and enable apply_token_bitmask_inplace_cuda in sgl-kernel (#8268)
```
  9c3e95d9
- [6/N] MoE Refactor: Cleanup MoE-related configs (#8849) · 29589512
  Cheng Wan authored Aug 14, 2025
  
  29589512
14 Aug, 2025 2 commits
- feat: Add model version tracking with API endpoints and response metadata (#8795) · c1c7dc45
  Chengxing Xie authored Aug 15, 2025
  
  c1c7dc45
- [4/n]decouple quantization implementation from vLLM dependency (#9191) · 2cc9eeab
  Hongbo Xu authored Aug 15, 2025
```
Co-authored-by: AniZpZ <aniz1905@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  2cc9eeab
13 Aug, 2025 1 commit
- [Generative Score API] Optimization to Remove Decode. (#8840) · a027a9b4
  Sundara Raman Ramachandran authored Aug 13, 2025
  
  a027a9b4