Commits · 9e2f7252db8f2e1b903dba31484f7efb0b772c41 · change / sglang

08 Sep, 2025 4 commits
- [Hicache]: Add E2E CI For 3FS-KVStore (#10131) · ec99668a
  hzh0425 authored Sep 08, 2025
  
  ec99668a
- [Bugfix] Qwen3MoE aclrtMemcpy failed with NPUGraph (#10013) · b67c277f
  Even Zhou authored Sep 08, 2025
  
  b67c277f
- Add graph runner support with torch compile on CPU (#7843) · 7577f0e4
  Cao E authored Sep 08, 2025
  
  7577f0e4
- Standalone speculative decoding (#10090) · 8cda5a62
  Qiaolin Yu authored Sep 07, 2025
  
  8cda5a62
06 Sep, 2025 2 commits
- [CI] Refactor disaggregation tests (#10068) · 00974e4f
  Shangming Cai authored Sep 06, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  00974e4f
- support Llama4 with non uniformed intermediate size across layers for… (#10047) · ab62b135
  gongwei-130 authored Sep 05, 2025
  
  ab62b135
04 Sep, 2025 3 commits
- metrics: support customer buckets for prompt/generation_tokens_histogram (#9634) · b32ab070
  Yingchun Lai authored Sep 04, 2025
  
  b32ab070
- feat(hicache): Add generic hicache ci e2e test and benchmark test (#9846) · 106c2b31
  hzh0425 authored Sep 04, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  106c2b31
- feat: add gpt oss b200 ci (#9988) · de921733
  Yineng Zhang authored Sep 03, 2025
  
  de921733
01 Sep, 2025 1 commit

Support Multi Process Tokenizer Manager(#6555) (#8964) · 5f77e129

ybyang authored Sep 01, 2025


Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>

5f77e129

29 Aug, 2025 1 commit

feat: add original logprobs to response (#8375) · 839c93bd

narutolhy authored Aug 29, 2025


Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: luhongyu.4869 <luhongyu.4869@bytedance.com>

839c93bd

28 Aug, 2025 1 commit
- [AMD] Support Hierarchical Caching on AMD GPUs (#8236) · 711390a9
  Hubert Lu authored Aug 28, 2025
  
  711390a9
26 Aug, 2025 1 commit
- [new feat] ascend backend support fia fusion kernel (#8328) · f92b729d
  ZhengdQin authored Aug 26, 2025
```
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
```
  f92b729d
25 Aug, 2025 1 commit

Fix Harmony reasoning parser for and auto-separation for gpt-oss models (#9190) · a0a77d93

Jonas authored Aug 26, 2025


Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: minleminzui <2969413251@qq.com>
Co-authored-by: maocheng23 <maocheng@berkeley.edu>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

a0a77d93

21 Aug, 2025 1 commit

[feature] Ascend NPU graph support (#9399) · 2c4b4b78

VDV1985 authored Aug 21, 2025


Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>

2c4b4b78

20 Aug, 2025 2 commits

Revert "[feature] Rework Ascend NPU graph support" (#9385) · de2dd738
Even Zhou authored Aug 20, 2025

de2dd738

[feature] Rework Ascend NPU graph support (#9350) · 3680d6f8

Even Zhou authored Aug 20, 2025


Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>

3680d6f8

19 Aug, 2025 1 commit
- Revert "[feature] Ascend NPU graph support (#8027)" (#9348) · f4fafacc
  Even Zhou authored Aug 20, 2025
  
  f4fafacc
17 Aug, 2025 2 commits

ci: simplify multi-modality tests by using mixins (#9006) · 1df84ff4
Mick authored Aug 17, 2025

1df84ff4

[feature] Ascend NPU graph support (#8027) · 94371dbb

VDV1985 authored Aug 17, 2025


Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>

94371dbb

16 Aug, 2025 1 commit
- [CI] add deepseek w4a8 test on h20 ci (#7758) · 81da16f6
  Hank Han authored Aug 16, 2025
  
  81da16f6
15 Aug, 2025 1 commit

[AMD] Expand test coverage for AMD CI and enable... · 9c3e95d9

Hubert Lu authored Aug 15, 2025

[AMD] Expand test coverage for AMD CI and enable apply_token_bitmask_inplace_cuda in sgl-kernel (#8268)

9c3e95d9

14 Aug, 2025 1 commit
- [4/n]decouple quantization implementation from vLLM dependency (#9191) · 2cc9eeab
  Hongbo Xu authored Aug 15, 2025
```
Co-authored-by: AniZpZ <aniz1905@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  2cc9eeab
13 Aug, 2025 1 commit
- Support Triton FP8 Gemm can handle hidden_dim not divisible by 16 (#9093) · 930fe467
  Stefan He authored Aug 12, 2025
```
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
```
  930fe467
12 Aug, 2025 1 commit

[AMD] Support Wave attention backend with AMD GPU optimizations (#8660) · 25caa7a8

jacky.cheng authored Aug 13, 2025


Signed-off-by: Stanley Winata <stanley.winata@amd.com>
Signed-off-by: Harsh Menon <harsh@nod-labs.com>
Signed-off-by: nithinsubbiah <nithinsubbiah@gmail.com>
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
Signed-off-by: xintin <gaurav.verma@amd.com>
Co-authored-by: Harsh Menon <harsh@nod-labs.com>
Co-authored-by: Stanley Winata <stanley.winata@amd.com>
Co-authored-by: Stanley Winata <68087699+raikonenfnu@users.noreply.github.com>
Co-authored-by: Stanley Winata <stanley@nod-labs.com>
Co-authored-by: Ivan Butygin <ivan.butygin@gmail.com>
Co-authored-by: nithinsubbiah <nithinsubbiah@gmail.com>
Co-authored-by: Nithin Meganathan <18070964+nithinsubbiah@users.noreply.github.com>
Co-authored-by: Ivan Butygin <ibutygin@amd.com>

25caa7a8

11 Aug, 2025 1 commit
- Support radix cache for Lora feature (#7216) · 75e6a7cd
  Baizhou Zhang authored Aug 11, 2025
  
  75e6a7cd
10 Aug, 2025 2 commits
- Reduce CI duration of test_lora_update. (#9024) · e322a94d
  Lifu Huang authored Aug 10, 2025
  
  e322a94d
- Reorganize CI and test files (#9027) · 2c7f01bc
  Lianmin Zheng authored Aug 10, 2025
  
  2c7f01bc
09 Aug, 2025 3 commits
- Fix CI (#9013) · ef48d554
  Lianmin Zheng authored Aug 09, 2025
  
  ef48d554
- Add CI for gpt-oss model on hopper (#8851) · 442534aa
  fzyzcjy authored Aug 09, 2025
  
  442534aa
- Clean up server_args.py to have a dedicated function for model specific adjustments (#8983) · 706bd69c
  Lianmin Zheng authored Aug 08, 2025
  
  706bd69c
08 Aug, 2025 2 commits

Revert "Support Multi Process Tokenizer Manager" (#8960) · a9471542
Lianmin Zheng authored Aug 08, 2025

a9471542

Support Multi Process Tokenizer Manager (#6555) · 7490e3f6

ybyang authored Aug 08, 2025


Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: lw9527 <952799980@qq.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>

7490e3f6

06 Aug, 2025 1 commit
- Support B200 in CI (#8861) · b114a810
  fzyzcjy authored Aug 06, 2025
  
  b114a810
04 Aug, 2025 1 commit
- [CI] Ascend NPU CI enhancement (#8294) · fee0ab0f
  Even Zhou authored Aug 04, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
```
  fee0ab0f
28 Jul, 2025 2 commits
- feat: throttle requests at scheduler based on --max_queued_requests (#7565) · 747dd450
  harrisonlimh authored Jul 28, 2025
  
  747dd450
- [feat] Support different attention backends for prefill and decode (#6338) · 28103384
  Qiaolin Yu authored Jul 27, 2025
```
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  28103384
26 Jul, 2025 1 commit

Extract update_weights from RL Engine to SGLang to keep simplicity and fix torch reduce (#8267) · ce32bc2b

Stefan He authored Jul 26, 2025

Co-authored-by: CuiBo 82354186+SuperCB@users.noreply.github.com
Co-authored-by: GeLee 865038696@qq.com
Co-authored-by: 杨睿 yangruipis@163.com

ce32bc2b

23 Jul, 2025 2 commits
- Fix gemma3n with hybrid swa (#8240) · 38000a5f
  Xinyuan Tong authored Jul 23, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  38000a5f
- Introduce Stable LoRA ID System for Overlapped Updates and Prefix Caching (#8261) · 8abd3e77
  Lifu Huang authored Jul 23, 2025
  
  8abd3e77