Commits · 3795b6a43f4cb0d8412cccfbb15d2c4f56203ce4 · change / sglang

15 Sep, 2025 4 commits
- fix(server_args): Skip chunked_prefill_size validation when disaggregation mode is decode (#10358) · 3795b6a4
  Jimmy authored Sep 15, 2025
  
  3795b6a4
- metrics: support customer labels specified in request header (#10143) · fc2c3a3d
  Yingchun Lai authored Sep 15, 2025
  
  fc2c3a3d
- [4/N]DP refactor: support watching mode `get_load` and shortest queue strategy (#10201) · 305c9e8c
  Liangsheng Yin authored Sep 15, 2025
  
  305c9e8c
- Add split tile size for Triton attention (#10425) · 60d7beda
  Ke Bao authored Sep 15, 2025
  
  60d7beda
14 Sep, 2025 2 commits
- [Feature] Sglang Tracing: Fine-Grained Tracking for Request Latency - Part 1 (#9962) · 4c21b090
  Feng Su authored Sep 15, 2025
```
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
Signed-off-by: Huaixin Chang <changhuaixin@linux.alibaba.com>
Signed-off-by: Peng Wang <rocking@linux.alibaba.com>
```
  4c21b090
- [Hack] Add pd-disaggregation decode polling interval (#10411) · 55a6e644
  Liangsheng Yin authored Sep 14, 2025
  
  55a6e644
13 Sep, 2025 1 commit
- [Performance] Dynamic Batch Tokenizer (#9382) · 94d0f656
  Sundara Raman Ramachandran authored Sep 13, 2025
  
  94d0f656
12 Sep, 2025 8 commits
- Support Qwen3-Next on Ascend NPU (#10379) · 16cd550c
  Even Zhou authored Sep 13, 2025
  
  16cd550c
- Support loading weights from remote instance (#8215) · 30d20ce8
  amysaq2023 authored Sep 12, 2025
```
Signed-off-by: Anqi Shen <amy.saq@antgroup.com>
Co-authored-by: Chayenne <74843776+zhaochenyang20@users.noreply.github.com>
```
  30d20ce8
- Fix Bailing MoE model bugs (#10362) · 24dc2bee
  Yuan Luo authored Sep 12, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: 羽癫 <yudian.zy@antgroup.com>
```
  24dc2bee
- Support LingV2 model (#10359) · fac07c9b
  strgrb authored Sep 12, 2025
```
Co-authored-by: 羽癫 <yudian.zy@antgroup.com>
Co-authored-by: guoyuhong <yuhong.gyh@antgroup.com>
```
  fac07c9b
- support memory_pool_host page first direct layout (#10031) · b4c2c421
  huangtingwei authored Sep 12, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  b4c2c421
- Implement Standalone gRPC Server for SGLang Python Scheduler (#10283) · 53ca1552
  Chang Su authored Sep 11, 2025
  
  53ca1552
- [NVIDIA] [3/N] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#9199) · 3df05f4d
  Shu Wang authored Sep 11, 2025
  
  3df05f4d
- [Auto Sync] Update server_args.py (20250912) (#10347) · 144ee5f3
  Lianmin Zheng authored Sep 11, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  144ee5f3
11 Sep, 2025 2 commits

[Minor] Improve the style of server args (#10328) · 64f296f8
Lianmin Zheng authored Sep 11, 2025

64f296f8

Yi Zhang authored Sep 11, 2025


Co-authored-by: cao1zhg <114661107+cao1zhg@users.noreply.github.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>
Co-authored-by: qingquansong <ustcsqq@gmail.com>
Co-authored-by: Yaoyao Ding <dingyaoyao.cs@gmail.com>
Co-authored-by: Ke Bao <ISPObaoke@163.com>
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>

30c6e1f5

10 Sep, 2025 3 commits
- [Bugfix] Fix Weightloading for the original nvidia/Deepseek-R1-FP4 checkpoint (#9940) · 21176b00
  Pavani Majety authored Sep 10, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  21176b00
- Fix: the default choice is wrong for flashinfer mxfp4 moe precision (#10253) · 737d73ed
  Yiyu Liu authored Sep 10, 2025
  
  737d73ed
- make --speculative-draft-model an alias of --speculative-draft-model-path (#10246) · 676a7b51
  Lianmin Zheng authored Sep 09, 2025
  
  676a7b51
09 Sep, 2025 2 commits
- [1/N]DP refactor: Improve dp rank scheduling in PD disaggregation mode. (#10169) · 83d55ac5
  Liangsheng Yin authored Sep 09, 2025
  
  83d55ac5
- Cleaning codes for speculative attention mode (#10149) · 8ad700f7
  Baizhou Zhang authored Sep 08, 2025
  
  8ad700f7
08 Sep, 2025 4 commits
- Revert "enable auto-round quantization model (#6226)" (#10148) · b7d1f17b
  Yineng Zhang authored Sep 07, 2025
  
  b7d1f17b
- enable auto-round quantization model (#6226) · c8295d23
  Weiwei authored Sep 08, 2025
```
Signed-off-by: Zhang, Weiwei1 <weiwei1.zhang@intel.com>
```
  c8295d23
- Add speculator attention backend switch (#9981) · 8c5930f0
  cicirori authored Sep 08, 2025
  
  8c5930f0
- Standalone speculative decoding (#10090) · 8cda5a62
  Qiaolin Yu authored Sep 07, 2025
  
  8cda5a62
07 Sep, 2025 1 commit

[Feature] LMCache Connector Integration (#9741) · 9a7ced4e

Yuwei An authored Sep 06, 2025


Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
Signed-off-by: YuhanLiu11 <yliu738@wisc.edu>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

9a7ced4e

06 Sep, 2025 1 commit

[Auto Sync] Update server_args.py (20250906) (#10117) · f3b67602

Lianmin Zheng authored Sep 06, 2025


Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>

f3b67602

05 Sep, 2025 3 commits
- [Fix] Add speculative_draft_model_revision to server_args (#5255) · 13705dae
  DevashishLal-CB authored Sep 05, 2025
```
Signed-off-by: Devashish Lal <devashish@rivosinc.com>
```
  13705dae
- Tiny support setting numa nodes for different ranks (#10006) · df97b31f
  fzyzcjy authored Sep 05, 2025
  
  df97b31f
- Simplify `Router` arguments passing and build it in docker image (#9964) · 6e95f5e5
  Liangsheng Yin authored Sep 05, 2025
  
  6e95f5e5
04 Sep, 2025 2 commits
- metrics: support customer buckets for prompt/generation_tokens_histogram (#9634) · b32ab070
  Yingchun Lai authored Sep 04, 2025
  
  b32ab070
- Fix Llama 4 with MXFP4 dynamic quant on MI35x (#9993) · 2c562fd2
  Hubert Lu authored Sep 04, 2025
  
  2c562fd2
03 Sep, 2025 3 commits
- Revert "[Fix] DeepSeek EP accuracy issue on B200 GPUs (#9946)" (#9955) · 2c7ca33a
  Yineng Zhang authored Sep 02, 2025
  
  2c7ca33a
- [Fix] DeepSeek EP accuracy issue on B200 GPUs (#9946) · 6243c367
  Al-Ekram Elahee Hridoy authored Sep 02, 2025
  
  6243c367
- Move parsers under a single folder (#9912) · 60e37f80
  Lianmin Zheng authored Sep 02, 2025
  
  60e37f80
01 Sep, 2025 1 commit

Support Multi Process Tokenizer Manager(#6555) (#8964) · 5f77e129

ybyang authored Sep 01, 2025


Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>

5f77e129

30 Aug, 2025 1 commit
- feature(eplb): add min-rebalancing-utilization-threshold for eplb (#8345) · c2a26e72
  hzh0425 authored Aug 30, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  c2a26e72
29 Aug, 2025 2 commits
- Raise error when `topk>1` and `page>1` for paged attention backends. (#9784) · a23c3020
  Liangsheng Yin authored Aug 29, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  a23c3020
- [HiCache] change the default policy to write through (#9772) · 001f5194
  Zhiqiang Xie authored Aug 28, 2025
  
  001f5194