Commits · 144ee5f37cc39706e7667b7584f11a930f37786e · change / sglang

12 Sep, 2025 1 commit

[Auto Sync] Update server_args.py (20250912) (#10347) · 144ee5f3

Lianmin Zheng authored Sep 11, 2025


Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Kan Wu <wukanustc@gmail.com>

144ee5f3

11 Sep, 2025 27 commits
- chore: bump v0.5.2 (#10221) · b0d25e72
  Yineng Zhang authored Sep 11, 2025
  
  b0d25e72
- add try catch for quant config hf download (#10340) · a2424068
  gongwei-130 authored Sep 11, 2025
  
  a2424068
- [LongCat] Optimize zero_experts_compute_triton by changing mask (#10303) · c5d2b01c
  zk-lover authored Sep 12, 2025
  
  c5d2b01c
- update GLM nightly test threshold (#10331) · 46ccbed2
  Minglei Zhu authored Sep 11, 2025
  
  46ccbed2
- Fix errors of hicache kernels in sgl-kernel for ROCm (#10339) · fe68c148
  Hubert Lu authored Sep 11, 2025
  
  fe68c148
- fix: trtllm-gen attention take zero-init workspace (#10330) · 70c0c1f9
  eigen authored Sep 11, 2025
  
  70c0c1f9
- add qwen3-next doc (#10327) · 760b788a
  Yi Zhang authored Sep 12, 2025
  
  760b788a
- [router][ci] add gpu process check and free port before start server (#10338) · 1ee11df8
  Keyang Ru authored Sep 11, 2025
  
  1ee11df8
- [router] Add OpenAI backend support - core function (#10254) · dee197e1
  Keyang Ru authored Sep 11, 2025
  
  dee197e1
- add h20 qwen3 next config (#10264) · ab795ae8
  Yi Zhang authored Sep 12, 2025
```
Co-authored-by: cao1zhg <114661107+cao1zhg@users.noreply.github.com>
```
  ab795ae8
- [router] add benchmark for regular router and pd router (#10280) · 480d1b8b
  Keyang Ru authored Sep 11, 2025
  
  480d1b8b
- [Qwen3-Next] switch to triton and cache conv states to accelerate MTP from 300... · 6c18ab46
  Stefan He authored Sep 11, 2025
```
[Qwen3-Next] switch to triton and cache conv states to accelerate MTP from 300 tok/s to 341 tok/s (#10335)
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
```
  6c18ab46
- [bugfix] fix norm type error in qwen3_next model (#10322) · 4a0e0be2
  cao1zhg authored Sep 12, 2025
```
Co-authored-by: caoyizhong.cyz <caoyizhong.cyz@alibaba-inc.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  4a0e0be2
- [Minor] Improve the style of server args (#10328) · 64f296f8
  Lianmin Zheng authored Sep 11, 2025
  
  64f296f8
- [Auto Sync] Update parallel_state.py (20250911) (#10326) · 956d805d
  Lianmin Zheng authored Sep 11, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
```
  956d805d
- Qwen3-Next support (#10233) · 30c6e1f5
  Yi Zhang authored Sep 11, 2025
```
Co-authored-by: cao1zhg <114661107+cao1zhg@users.noreply.github.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>
Co-authored-by: qingquansong <ustcsqq@gmail.com>
Co-authored-by: Yaoyao Ding <dingyaoyao.cs@gmail.com>
Co-authored-by: Ke Bao <ISPObaoke@163.com>
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
```
  30c6e1f5
- chore: upgrade v0.3.9.post2 sgl-kernel (#10297) · bfe01a5e
  Yineng Zhang authored Sep 11, 2025
  
  bfe01a5e
- [CI] add pyproject.toml to deepseek w4a8 ci (#10314) · 3dd6420a
  Hank Han authored Sep 11, 2025
  
  3dd6420a
- chore: bump sgl-kernel 0.3.9.post2 (#10311) · 532f998b
  Yineng Zhang authored Sep 11, 2025
  
  532f998b
- Revert "Fix flashinfer version in sgl-kernel (#10135)" (#10310) · de15d140
  Yineng Zhang authored Sep 11, 2025
  
  de15d140
- [fix CI] Fix logical condition in fused MoE layer for compressed tensor quantization (#10299) · 37367da6
  Xiaoyu Zhang authored Sep 11, 2025
  
  37367da6
- [CPU] fix OOM when mem-fraction is not set (#9090) · ef959d7b
  Zaili Wang authored Sep 11, 2025
  
  ef959d7b
- [chore]Add sgl-router to npu images (#10229) · 4aa1e69b
  BourneSun0527 authored Sep 11, 2025
  
  4aa1e69b
- add flash linear attention triton kernel (#10239) · dc491b39
  Yi Zhang authored Sep 11, 2025
  
  dc491b39
- [Feature] Support DeepEP normal & Redundant Experts on NPU (#9881) · 5b64f006
  Even Zhou authored Sep 11, 2025
  
  5b64f006
- chore: bump sgl-kernel 0.3.9.post1 (#10294) · 5b7448de
  Yineng Zhang authored Sep 10, 2025
  
  5b7448de
- Revert "[1/2] Optimizations and refactors about quant kernel (#9534)" (#10292) · 6d55f60e
  Yineng Zhang authored Sep 10, 2025
  
  6d55f60e
10 Sep, 2025 12 commits
- [Auto Sync] Update serving_base.py, serving_chat.py, servin... (20250910) (#10282) · 033b75f5
  Lianmin Zheng authored Sep 10, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
```
  033b75f5
- Feat: support disable tool parser (#10184) · f3b5db6e
  Xinyuan Tong authored Sep 10, 2025
  
  f3b5db6e
- pass a_scale from fp8 quant result instead of hard code to 1.0f (#10241) · 2286e85e
  Rain Jiang authored Sep 10, 2025
```
Co-authored-by: Yichen Wang <yichen.wang@bytedance.com>
Co-authored-by: Jinwu Guo <641876696@qq.com>
```
  2286e85e
- Add tests to AMD CI for MI35x (#9662) · 91b3555d
  Hubert Lu authored Sep 10, 2025
```
Co-authored-by: Sai Enduri <saimanas.enduri@amd.com>
```
  91b3555d
- add dual stream for qwen2_moe (#10252) · 9e2f7252
  Yi Zhang authored Sep 11, 2025
  
  9e2f7252
- [Bugfix] Fix Weightloading for the original nvidia/Deepseek-R1-FP4 checkpoint (#9940) · 21176b00
  Pavani Majety authored Sep 10, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  21176b00
- [1/2] Refactor LoRA to support backend-specific batch preprocessing. (#10251) · 94100294
  Lifu Huang authored Sep 10, 2025
  
  94100294
- [router] Add PD router mmlu test (#10256) · cda7e47c
  Keyang Ru authored Sep 10, 2025
  
  cda7e47c
- Fix potential flakiness in test_lora_qwen3 (#10250) · e903f695
  Lifu Huang authored Sep 10, 2025
  
  e903f695
- [Auto Sync] Update io_struct.py (20250910) (#10262) · 27760fc1
  Lianmin Zheng authored Sep 10, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  27760fc1
- Fix assertion typo in tp_worker.py (#9954) · 0ac809de
  Seunggeun Cho authored Sep 10, 2025
  
  0ac809de
- support vlm model spec bench (#10173) · 4efe2c57
  Lzhang-hub authored Sep 10, 2025
  
  4efe2c57