Commits · 24a8cee66d9f99e7077bb6d9b74936e8641922cb · change / sglang

21 Aug, 2025 1 commit

[feature] Ascend NPU graph support (#9399) · 2c4b4b78

VDV1985 authored Aug 21, 2025


Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>

2c4b4b78

20 Aug, 2025 2 commits

Revert "[feature] Rework Ascend NPU graph support" (#9385) · de2dd738
Even Zhou authored Aug 20, 2025

de2dd738

[feature] Rework Ascend NPU graph support (#9350) · 3680d6f8

Even Zhou authored Aug 20, 2025


Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>

3680d6f8

19 Aug, 2025 1 commit
- Revert "[feature] Ascend NPU graph support (#8027)" (#9348) · f4fafacc
  Even Zhou authored Aug 20, 2025
  
  f4fafacc
17 Aug, 2025 2 commits

ci: simplify multi-modality tests by using mixins (#9006) · 1df84ff4
Mick authored Aug 17, 2025

1df84ff4

[feature] Ascend NPU graph support (#8027) · 94371dbb

VDV1985 authored Aug 17, 2025


Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>

94371dbb

16 Aug, 2025 1 commit
- [CI] add deepseek w4a8 test on h20 ci (#7758) · 81da16f6
  Hank Han authored Aug 16, 2025
  
  81da16f6
15 Aug, 2025 1 commit

[AMD] Expand test coverage for AMD CI and enable... · 9c3e95d9

Hubert Lu authored Aug 15, 2025

[AMD] Expand test coverage for AMD CI and enable apply_token_bitmask_inplace_cuda in sgl-kernel (#8268)

9c3e95d9

14 Aug, 2025 1 commit
- [4/n]decouple quantization implementation from vLLM dependency (#9191) · 2cc9eeab
  Hongbo Xu authored Aug 15, 2025
```
Co-authored-by: AniZpZ <aniz1905@gmail.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  2cc9eeab
13 Aug, 2025 1 commit
- Support Triton FP8 Gemm can handle hidden_dim not divisible by 16 (#9093) · 930fe467
  Stefan He authored Aug 12, 2025
```
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
```
  930fe467
12 Aug, 2025 1 commit

[AMD] Support Wave attention backend with AMD GPU optimizations (#8660) · 25caa7a8

jacky.cheng authored Aug 13, 2025


Signed-off-by: Stanley Winata <stanley.winata@amd.com>
Signed-off-by: Harsh Menon <harsh@nod-labs.com>
Signed-off-by: nithinsubbiah <nithinsubbiah@gmail.com>
Signed-off-by: Ivan Butygin <ivan.butygin@gmail.com>
Signed-off-by: xintin <gaurav.verma@amd.com>
Co-authored-by: Harsh Menon <harsh@nod-labs.com>
Co-authored-by: Stanley Winata <stanley.winata@amd.com>
Co-authored-by: Stanley Winata <68087699+raikonenfnu@users.noreply.github.com>
Co-authored-by: Stanley Winata <stanley@nod-labs.com>
Co-authored-by: Ivan Butygin <ivan.butygin@gmail.com>
Co-authored-by: nithinsubbiah <nithinsubbiah@gmail.com>
Co-authored-by: Nithin Meganathan <18070964+nithinsubbiah@users.noreply.github.com>
Co-authored-by: Ivan Butygin <ibutygin@amd.com>

25caa7a8

11 Aug, 2025 1 commit
- Support radix cache for Lora feature (#7216) · 75e6a7cd
  Baizhou Zhang authored Aug 11, 2025
  
  75e6a7cd
10 Aug, 2025 2 commits
- Reduce CI duration of test_lora_update. (#9024) · e322a94d
  Lifu Huang authored Aug 10, 2025
  
  e322a94d
- Reorganize CI and test files (#9027) · 2c7f01bc
  Lianmin Zheng authored Aug 10, 2025
  
  2c7f01bc
09 Aug, 2025 3 commits
- Fix CI (#9013) · ef48d554
  Lianmin Zheng authored Aug 09, 2025
  
  ef48d554
- Add CI for gpt-oss model on hopper (#8851) · 442534aa
  fzyzcjy authored Aug 09, 2025
  
  442534aa
- Clean up server_args.py to have a dedicated function for model specific adjustments (#8983) · 706bd69c
  Lianmin Zheng authored Aug 08, 2025
  
  706bd69c
08 Aug, 2025 2 commits

Revert "Support Multi Process Tokenizer Manager" (#8960) · a9471542
Lianmin Zheng authored Aug 08, 2025

a9471542

Support Multi Process Tokenizer Manager (#6555) · 7490e3f6

ybyang authored Aug 08, 2025


Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: lw9527 <952799980@qq.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>

7490e3f6

06 Aug, 2025 1 commit
- Support B200 in CI (#8861) · b114a810
  fzyzcjy authored Aug 06, 2025
  
  b114a810
04 Aug, 2025 1 commit
- [CI] Ascend NPU CI enhancement (#8294) · fee0ab0f
  Even Zhou authored Aug 04, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
```
  fee0ab0f
28 Jul, 2025 2 commits
- feat: throttle requests at scheduler based on --max_queued_requests (#7565) · 747dd450
  harrisonlimh authored Jul 28, 2025
  
  747dd450
- [feat] Support different attention backends for prefill and decode (#6338) · 28103384
  Qiaolin Yu authored Jul 27, 2025
```
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  28103384
26 Jul, 2025 1 commit

Extract update_weights from RL Engine to SGLang to keep simplicity and fix torch reduce (#8267) · ce32bc2b

Stefan He authored Jul 26, 2025

Co-authored-by: CuiBo 82354186+SuperCB@users.noreply.github.com
Co-authored-by: GeLee 865038696@qq.com
Co-authored-by: 杨睿 yangruipis@163.com

ce32bc2b

23 Jul, 2025 2 commits
- Fix gemma3n with hybrid swa (#8240) · 38000a5f
  Xinyuan Tong authored Jul 23, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  38000a5f
- Introduce Stable LoRA ID System for Overlapped Updates and Prefix Caching (#8261) · 8abd3e77
  Lifu Huang authored Jul 23, 2025
  
  8abd3e77
20 Jul, 2025 1 commit
- Add get_hidden_dim to qwen3.py for correct lora (#7312) · 877e35d7
  Pavel Logachev authored Jul 20, 2025
  
  877e35d7
19 Jul, 2025 2 commits
- Support start up LoRA server without initial adapters (#8019) · 4e3defe5
  Lifu Huang authored Jul 19, 2025
  
  4e3defe5
- Fix LoRA buffer contamination during adapter eviction (#8103) · 3de617a7
  Lifu Huang authored Jul 19, 2025
  
  3de617a7
18 Jul, 2025 3 commits
- [Doc] Steps to add a new attention backend (#8155) · 9c7a4618
  Lianmin Zheng authored Jul 18, 2025
  
  9c7a4618
- [AMD] Add triton awq_dequantize kernel to support AWQ on ROCm (#7661) · 7750b91c
  Hubert Lu authored Jul 18, 2025
  
  7750b91c
- Hicache Storage Layer Prototype (#7704) · 9d33fcfb
  Zhiqiang Xie authored Jul 18, 2025
  
  9d33fcfb
14 Jul, 2025 1 commit
- Refactor dynamic LoRA update to fix incorrect handling of variant weight shapes (#7844) · e2ed9d04
  Lifu Huang authored Jul 13, 2025
  
  e2ed9d04
10 Jul, 2025 1 commit
- [feature] Add start step profile argument in /start_profile (#7608) · dd445a41
  kyleliang-nv authored Jul 09, 2025
  
  dd445a41
09 Jul, 2025 1 commit
- [CI] Add deepep tests to CI (#7872) · d487555f
  Cheng Wan authored Jul 09, 2025
  
  d487555f
08 Jul, 2025 2 commits
- fix: Handles input_embeds in GenerateReqInput when n>1 (#7830) · 136c6e04
  Xinyuan Tong authored Jul 08, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  136c6e04
- [Minor] Fix sporadic CI timeout caused by underestimated tests. (#7850) · 2b0e1d1c
  Lifu Huang authored Jul 08, 2025
  
  2b0e1d1c
06 Jul, 2025 1 commit
- [AMD] Add test_fused_moe.py and test_rope_rocm.py to AMD CI (#5246) · e00715eb
  Hubert Lu authored Jul 06, 2025
  
  e00715eb
04 Jul, 2025 1 commit
- Add V2-lite model test (#7390) · 4de03953
  YanbingJiang authored Jul 04, 2025
```
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
```
  4de03953
03 Jul, 2025 1 commit

Ascend attention backend(PA&MLA) (#7722) · 1e0e5497

ronnie_zheng authored Jul 03, 2025


Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: VDV1985 <vladdv85@mail.ru>

1e0e5497