Commits · 5e21d6aec052e371ab9763f71ab911a72bfca22e · change / sglang · GitLab

25 Sep, 2025 5 commits
- Refactor kv_cache_scheme handling for quantization (#10132) · cd4da1f1
  Mohammad Miadh Angkad authored Sep 26, 2025
  
  cd4da1f1
- router: Fix constraint proto and `build_constraint` in grpc router (#10881) · 91678474
  Chang Su authored Sep 25, 2025
  
  91678474
- integrate AIBrix KVcache (#10376) · fce17048
  yi wang authored Sep 25, 2025
  
  fce17048
- [HiCache] Cleaning the deprecated host memory state (#10778) · 3d40794f
  Zhiqiang Xie authored Sep 24, 2025
  
  3d40794f
- [Auto Sync] Update model_config.py (20250925) (#10885) · 3e43eb13
  Lianmin Zheng authored Sep 24, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  3e43eb13
24 Sep, 2025 5 commits
- Restruct sgl-kernel benchmark (#10861) · c4e314f9
  Xiaoyu Zhang authored Sep 25, 2025
  
  c4e314f9
- chore: Initial support for input config files (#10534) · d7b20dd6
  kushanam authored Sep 24, 2025
```
Co-authored-by: root <root@umbriel-b200-017.ipp4a1.colossus.nvidia.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  d7b20dd6
- fix bailing_moe with enable_dp_attention (#10860) · cd641a99
  GuoweiWangU authored Sep 24, 2025
  
  cd641a99
- feat: add cache_salt support to request (#10718) · 71f24ef8
  Xinyuan Tong authored Sep 23, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  71f24ef8
- Revert "[fix][pd-disag]no need set next batch sampling info done in prefill" (#10828) · 32d89373
  Lianmin Zheng authored Sep 23, 2025
  
  32d89373
23 Sep, 2025 20 commits
- [Auto Sync] Update load_config.py, model_config.py, configu... (20250923) (#10825) · f47a2c67
  Lianmin Zheng authored Sep 23, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
```
  f47a2c67
- [Auto Sync] Update simple_eval_common.py (20250923) (#10824) · 312bfc4c
  Lianmin Zheng authored Sep 23, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
```
  312bfc4c
- [Auto Sync] Update elementwise.py (20250923) (#10823) · e290303e
  Lianmin Zheng authored Sep 23, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  e290303e
- fix: draft model IMA by overide max_positional_embeddings (#10787) · aab35bcc
  Xinyuan Tong authored Sep 23, 2025
```
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
```
  aab35bcc
- [Auto Sync] Update protocol.py (20250923) (#10820) · 42aedb02
  Yineng Zhang authored Sep 23, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cicirori <32845984+cicirori@users.noreply.github.com>
```
  42aedb02
- add tunning files for QWEN-3-NEXT (#10794) · 984730b7
  Yiakwy authored Sep 24, 2025
  
  984730b7
- Remove duplicate code in qwen2 model (#10540) · d42975c6
  Lzhang-hub authored Sep 24, 2025
  
  d42975c6
- [fix][pd-disag]no need set next batch sampling info done in prefill (#10259) · 4b5ef300
  Jimmy authored Sep 24, 2025
  
  4b5ef300
- model: support qwen3-vl series (#10323) · 4f564b9e
  Zheng Li authored Sep 24, 2025
```
Co-authored-by: ocss884 <ocss.lin@gmail.com>
Co-authored-by: cao1zhg <653506626@qq.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: 瑀澈 <yuche.lz@alibaba-inc.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  4f564b9e
- move `environ` into `sglang.srt` to avoid break SRT auto sync. (#10791) · 4a762041
  Liangsheng Yin authored Sep 23, 2025
  
  4a762041
- Clean up server args (#10770) · ea338676
  Lianmin Zheng authored Sep 23, 2025
  
  ea338676
- chore: upgrade sgl-kernel 0.3.12 (#10782) · 8c1ef0f9
  Yineng Zhang authored Sep 23, 2025
  
  8c1ef0f9
- Introduce `FutureMap` (#10715) · f5a2faf2
  Liangsheng Yin authored Sep 23, 2025
  
  f5a2faf2
- Move cached kernel to srt.utils (#10776) · 9241f4fd
  Lifu Huang authored Sep 22, 2025
  
  9241f4fd
- Fix trtllm_mla slow concat kernel in MTP (#10777) · 063c3791
  fzyzcjy authored Sep 23, 2025
  
  063c3791
- Use simulate acc len from `sglang.environ` (#10771) · 632b7d8c
  Liangsheng Yin authored Sep 23, 2025
  
  632b7d8c
- [Auto Sync] Update configurer.py (20250923) (#10765) · 113f8f65
  Lianmin Zheng authored Sep 22, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
```
  113f8f65
- [Ascend]optimize Qwen3 on Ascend (#10574) · e22f3a5e
  ronnie_zheng authored Sep 23, 2025
```
Co-authored-by: c30031083 <chenxu140@huawei.com>
```
  e22f3a5e
- [Ascend] optimize Qwen-vl on Ascend (#10556) · 095093ee
  ronnie_zheng authored Sep 23, 2025
```
Co-authored-by: wangqihui01 <wangqh10@163.com>
```
  095093ee
- [Feature] Add MLAProcess for DeepSeek MLA on NPU (#10130) · d27a6f70
  Even Zhou authored Sep 23, 2025
  
  d27a6f70
22 Sep, 2025 10 commits
- [Auto Sync] Update flashattention_backend.py (20250922) (#10762) · 0753ef83
  Yineng Zhang authored Sep 22, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Gordon Gustafson <ggustafson@together.ai>
```
  0753ef83
- fix: kv events with tp > 1 (#10541) · 662393f2
  ishandhanani authored Sep 23, 2025
  
  662393f2
- Enables TRT-LLM backend to be used for target_verify (#10281) · b1bb8e74
  pranavm-nvidia authored Sep 22, 2025
```
Co-authored-by: Pranav Marathe <pranavm@ipp1-3309.ipp1a1.colossus.nvidia.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
```
  b1bb8e74
- Fix multimodal registry and code sync scripts (#10759) · 38c00ed7
  Lianmin Zheng authored Sep 22, 2025
```
Co-authored-by: cctry <shiyang@x.ai>
```
  38c00ed7
- refactor zero copy (#10300) · d4041a5e
  pansicheng authored Sep 23, 2025
```
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  d4041a5e
- Fix MTP MoE weight loading with NVFP4 target model. (#10758) · 9c53dad8
  Jue WANG authored Sep 22, 2025
  
  9c53dad8
- Add warnings and remove dependency for deterministic inference (#10724) · aa1c5cf5
  Baizhou Zhang authored Sep 22, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  aa1c5cf5
- Fix CI TestChunkedSGMV (#10737) · 2101d93b
  Lifu Huang authored Sep 22, 2025
  
  2101d93b
- fix capture_bs when speculative decoding enabled (#10730) · 944f1ea0
  feng397 authored Sep 22, 2025
  
  944f1ea0
- EPLB: prefer to use physical experts in the same node (#9849) · 9d7e82a0
  Yingchun Lai authored Sep 22, 2025
  
  9d7e82a0