Commits · ea338676b5024188db7f20e54a80b06c8effd72e · change / sglang

23 Sep, 2025 2 commits
- Clean up server args (#10770) · ea338676
  Lianmin Zheng authored Sep 23, 2025
  
  ea338676
- [Ascend] optimize Qwen-vl on Ascend (#10556) · 095093ee
  ronnie_zheng authored Sep 23, 2025
```
Co-authored-by: wangqihui01 <wangqh10@163.com>
```
  095093ee
22 Sep, 2025 3 commits
- Add warnings and remove dependency for deterministic inference (#10724) · aa1c5cf5
  Baizhou Zhang authored Sep 22, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  aa1c5cf5
- [2/2] Support deterministic inference for temperature > 0 (#10678) · e2ac7888
  Qiaolin Yu authored Sep 21, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
```
  e2ac7888
- Support deterministic inference with triton backend (#10694) · 134b4f7e
  Ethan (Yusheng) Su authored Sep 21, 2025
  
  134b4f7e
21 Sep, 2025 4 commits
- [3/4] Speed up CSGMV backend perf by 10% through dynamic chunking + kernel optimization (#10592) · 08ecd0aa
  Lifu Huang authored Sep 20, 2025
  
  08ecd0aa
- Super tiny fix extra logs (#10697) · 720c1c8c
  fzyzcjy authored Sep 21, 2025
  
  720c1c8c
- feat: update server args (#10696) · d403c143
  Yineng Zhang authored Sep 20, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  d403c143
- [Feature] Support deterministic inference with FA3 backend (#10651) · cba0d8c3
  Stefan He authored Sep 20, 2025
  
  cba0d8c3
20 Sep, 2025 1 commit
- [1/2] Support deterministic inference with flashinfer attention backend (#10645) · 8ecef73f
  Baizhou Zhang authored Sep 19, 2025
```
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  8ecef73f
18 Sep, 2025 3 commits
- [Feature] Speculative decoding support lookahead (#9873) · e7bc6003
  Zhihao Zhang authored Sep 19, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  e7bc6003
- feat: Add FlexAttention Backend for Efficient Sparse Attention (#9947) · 9a5c42f9
  yuk.igalaxy authored Sep 19, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  9a5c42f9
- [HICache] introduce evict policy (#10190) · 1ccd59c7
  Xuchun Shang authored Sep 18, 2025
```
Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
```
  1ccd59c7
17 Sep, 2025 2 commits
- vlm: remove redundant d2h movement of mm feature tensors (#9987) · de28f8e7
  Kevin Xiang Li authored Sep 17, 2025
```
Co-authored-by: Xiang (Kevin) Li <lik@nvidia.com>
```
  de28f8e7
- feat: add priority based scheduling with priority based request acceptance and preemption (#8746) · 14fdd527
  harrisonlimh authored Sep 16, 2025
  
  14fdd527
16 Sep, 2025 2 commits
- support using fa4 on deepseek on blackwell (#9928) · a2f7218a
  cicirori authored Sep 17, 2025
  
  a2f7218a
- [CPU] fix CPU backend sel. issue for Llama4 (#10511) · 925dbb32
  Zaili Wang authored Sep 16, 2025
  
  925dbb32
15 Sep, 2025 5 commits
- [2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for... · 3f41b48c
  Lifu Huang authored Sep 15, 2025
```
[2/2] Introduce Chunked-SGMV kernels and corresponding LoRA backend for improved performance (#10286)
```
  3f41b48c
- fix(server_args): Skip chunked_prefill_size validation when disaggregation mode is decode (#10358) · 3795b6a4
  Jimmy authored Sep 15, 2025
  
  3795b6a4
- metrics: support customer labels specified in request header (#10143) · fc2c3a3d
  Yingchun Lai authored Sep 15, 2025
  
  fc2c3a3d
- [4/N]DP refactor: support watching mode `get_load` and shortest queue strategy (#10201) · 305c9e8c
  Liangsheng Yin authored Sep 15, 2025
  
  305c9e8c
- Add split tile size for Triton attention (#10425) · 60d7beda
  Ke Bao authored Sep 15, 2025
  
  60d7beda
14 Sep, 2025 2 commits
- [Feature] Sglang Tracing: Fine-Grained Tracking for Request Latency - Part 1 (#9962) · 4c21b090
  Feng Su authored Sep 15, 2025
```
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
Signed-off-by: Huaixin Chang <changhuaixin@linux.alibaba.com>
Signed-off-by: Peng Wang <rocking@linux.alibaba.com>
```
  4c21b090
- [Hack] Add pd-disaggregation decode polling interval (#10411) · 55a6e644
  Liangsheng Yin authored Sep 14, 2025
  
  55a6e644
13 Sep, 2025 1 commit
- [Performance] Dynamic Batch Tokenizer (#9382) · 94d0f656
  Sundara Raman Ramachandran authored Sep 13, 2025
  
  94d0f656
12 Sep, 2025 8 commits
- Support Qwen3-Next on Ascend NPU (#10379) · 16cd550c
  Even Zhou authored Sep 13, 2025
  
  16cd550c
- Support loading weights from remote instance (#8215) · 30d20ce8
  amysaq2023 authored Sep 12, 2025
```
Signed-off-by: Anqi Shen <amy.saq@antgroup.com>
Co-authored-by: Chayenne <74843776+zhaochenyang20@users.noreply.github.com>
```
  30d20ce8
- Fix Bailing MoE model bugs (#10362) · 24dc2bee
  Yuan Luo authored Sep 12, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: 羽癫 <yudian.zy@antgroup.com>
```
  24dc2bee
- Support LingV2 model (#10359) · fac07c9b
  strgrb authored Sep 12, 2025
```
Co-authored-by: 羽癫 <yudian.zy@antgroup.com>
Co-authored-by: guoyuhong <yuhong.gyh@antgroup.com>
```
  fac07c9b
- support memory_pool_host page first direct layout (#10031) · b4c2c421
  huangtingwei authored Sep 12, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  b4c2c421
- Implement Standalone gRPC Server for SGLang Python Scheduler (#10283) · 53ca1552
  Chang Su authored Sep 11, 2025
  
  53ca1552
- [NVIDIA] [3/N] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#9199) · 3df05f4d
  Shu Wang authored Sep 11, 2025
  
  3df05f4d
- [Auto Sync] Update server_args.py (20250912) (#10347) · 144ee5f3
  Lianmin Zheng authored Sep 11, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  144ee5f3
11 Sep, 2025 2 commits

[Minor] Improve the style of server args (#10328) · 64f296f8
Lianmin Zheng authored Sep 11, 2025

64f296f8

Yi Zhang authored Sep 11, 2025


Co-authored-by: cao1zhg <114661107+cao1zhg@users.noreply.github.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: Lifu Huang <lifu.hlf@gmail.com>
Co-authored-by: qingquansong <ustcsqq@gmail.com>
Co-authored-by: Yaoyao Ding <dingyaoyao.cs@gmail.com>
Co-authored-by: Ke Bao <ISPObaoke@163.com>
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>

30c6e1f5

10 Sep, 2025 3 commits
- [Bugfix] Fix Weightloading for the original nvidia/Deepseek-R1-FP4 checkpoint (#9940) · 21176b00
  Pavani Majety authored Sep 10, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  21176b00
- Fix: the default choice is wrong for flashinfer mxfp4 moe precision (#10253) · 737d73ed
  Yiyu Liu authored Sep 10, 2025
  
  737d73ed
- make --speculative-draft-model an alias of --speculative-draft-model-path (#10246) · 676a7b51
  Lianmin Zheng authored Sep 09, 2025
  
  676a7b51
09 Sep, 2025 2 commits
- [1/N]DP refactor: Improve dp rank scheduling in PD disaggregation mode. (#10169) · 83d55ac5
  Liangsheng Yin authored Sep 09, 2025
  
  83d55ac5
- Cleaning codes for speculative attention mode (#10149) · 8ad700f7
  Baizhou Zhang authored Sep 08, 2025
  
  8ad700f7