Commits · 7ec5b4e89c16dc91bfee64099fa8d7ad7bb538a2 · change / sglang · GitLab

26 Sep, 2025 5 commits
- [PD-HiCache]: Support Async Offloading KVCache In Decode Side (#10192) · 7ec5b4e8
  hzh0425 authored Sep 26, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  7ec5b4e8
- Revert "Refactor kv_cache_scheme handling for quantization (#10132)" (#10935) · 172bcf01
  Yineng Zhang authored Sep 25, 2025
  
  172bcf01
- router: Support parallel sampling num > 1 in grpc_server and non-stream handling (#10929) · 37158f20
  Chang Su authored Sep 25, 2025
  
  37158f20
- Replace the Kimi-K2 generated tool call idx with history tool call count (#10612) · 0ac61146
  eraser00 authored Sep 26, 2025
```
Co-authored-by: eraser00 <eraser00@github.com>
```
  0ac61146
- [router][refactor] Clean up protobuf fields (#10923) · 7dcd689b
  Chang Su authored Sep 25, 2025
  
  7dcd689b
25 Sep, 2025 8 commits
- Rename customer label -> custom label (#10899) · f68dd998
  Lianmin Zheng authored Sep 25, 2025
```
Co-authored-by: Yingchun Lai <laiyingchun@apache.org>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  f68dd998
- [minor] Remove deprecated function `get_ip` (#10883) · 35ec2a45
  Lianmin Zheng authored Sep 25, 2025
  
  35ec2a45
- fix env flashinfer (#10910) · 0035f1ce
  Swipe4057 authored Sep 26, 2025
  
  0035f1ce
- Refactor kv_cache_scheme handling for quantization (#10132) · cd4da1f1
  Mohammad Miadh Angkad authored Sep 26, 2025
  
  cd4da1f1
- router: Fix constraint proto and `build_constraint` in grpc router (#10881) · 91678474
  Chang Su authored Sep 25, 2025
  
  91678474
- integrate AIBrix KVcache (#10376) · fce17048
  yi wang authored Sep 25, 2025
  
  fce17048
- [HiCache] Cleaning the deprecated host memory state (#10778) · 3d40794f
  Zhiqiang Xie authored Sep 24, 2025
  
  3d40794f
- [Auto Sync] Update model_config.py (20250925) (#10885) · 3e43eb13
  Lianmin Zheng authored Sep 24, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  3e43eb13
24 Sep, 2025 5 commits
- Restruct sgl-kernel benchmark (#10861) · c4e314f9
  Xiaoyu Zhang authored Sep 25, 2025
  
  c4e314f9
- chore: Initial support for input config files (#10534) · d7b20dd6
  kushanam authored Sep 24, 2025
```
Co-authored-by: root <root@umbriel-b200-017.ipp4a1.colossus.nvidia.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  d7b20dd6
- fix bailing_moe with enable_dp_attention (#10860) · cd641a99
  GuoweiWangU authored Sep 24, 2025
  
  cd641a99
- feat: add cache_salt support to request (#10718) · 71f24ef8
  Xinyuan Tong authored Sep 23, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  71f24ef8
- Revert "[fix][pd-disag]no need set next batch sampling info done in prefill" (#10828) · 32d89373
  Lianmin Zheng authored Sep 23, 2025
  
  32d89373
23 Sep, 2025 20 commits
- [Auto Sync] Update load_config.py, model_config.py, configu... (20250923) (#10825) · f47a2c67
  Lianmin Zheng authored Sep 23, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
```
  f47a2c67
- [Auto Sync] Update simple_eval_common.py (20250923) (#10824) · 312bfc4c
  Lianmin Zheng authored Sep 23, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
```
  312bfc4c
- [Auto Sync] Update elementwise.py (20250923) (#10823) · e290303e
  Lianmin Zheng authored Sep 23, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  e290303e
- fix: draft model IMA by overide max_positional_embeddings (#10787) · aab35bcc
  Xinyuan Tong authored Sep 23, 2025
```
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
```
  aab35bcc
- [Auto Sync] Update protocol.py (20250923) (#10820) · 42aedb02
  Yineng Zhang authored Sep 23, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cicirori <32845984+cicirori@users.noreply.github.com>
```
  42aedb02
- add tunning files for QWEN-3-NEXT (#10794) · 984730b7
  Yiakwy authored Sep 24, 2025
  
  984730b7
- Remove duplicate code in qwen2 model (#10540) · d42975c6
  Lzhang-hub authored Sep 24, 2025
  
  d42975c6
- [fix][pd-disag]no need set next batch sampling info done in prefill (#10259) · 4b5ef300
  Jimmy authored Sep 24, 2025
  
  4b5ef300
- model: support qwen3-vl series (#10323) · 4f564b9e
  Zheng Li authored Sep 24, 2025
```
Co-authored-by: ocss884 <ocss.lin@gmail.com>
Co-authored-by: cao1zhg <653506626@qq.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: 瑀澈 <yuche.lz@alibaba-inc.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  4f564b9e
- move `environ` into `sglang.srt` to avoid break SRT auto sync. (#10791) · 4a762041
  Liangsheng Yin authored Sep 23, 2025
  
  4a762041
- Clean up server args (#10770) · ea338676
  Lianmin Zheng authored Sep 23, 2025
  
  ea338676
- chore: upgrade sgl-kernel 0.3.12 (#10782) · 8c1ef0f9
  Yineng Zhang authored Sep 23, 2025
  
  8c1ef0f9
- Introduce `FutureMap` (#10715) · f5a2faf2
  Liangsheng Yin authored Sep 23, 2025
  
  f5a2faf2
- Move cached kernel to srt.utils (#10776) · 9241f4fd
  Lifu Huang authored Sep 22, 2025
  
  9241f4fd
- Fix trtllm_mla slow concat kernel in MTP (#10777) · 063c3791
  fzyzcjy authored Sep 23, 2025
  
  063c3791
- Use simulate acc len from `sglang.environ` (#10771) · 632b7d8c
  Liangsheng Yin authored Sep 23, 2025
  
  632b7d8c
- [Auto Sync] Update configurer.py (20250923) (#10765) · 113f8f65
  Lianmin Zheng authored Sep 22, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
```
  113f8f65
- [Ascend]optimize Qwen3 on Ascend (#10574) · e22f3a5e
  ronnie_zheng authored Sep 23, 2025
```
Co-authored-by: c30031083 <chenxu140@huawei.com>
```
  e22f3a5e
- [Ascend] optimize Qwen-vl on Ascend (#10556) · 095093ee
  ronnie_zheng authored Sep 23, 2025
```
Co-authored-by: wangqihui01 <wangqh10@163.com>
```
  095093ee
- [Feature] Add MLAProcess for DeepSeek MLA on NPU (#10130) · d27a6f70
  Even Zhou authored Sep 23, 2025
  
  d27a6f70
22 Sep, 2025 2 commits
- [Auto Sync] Update flashattention_backend.py (20250922) (#10762) · 0753ef83
  Yineng Zhang authored Sep 22, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Gordon Gustafson <ggustafson@together.ai>
```
  0753ef83
- fix: kv events with tp > 1 (#10541) · 662393f2
  ishandhanani authored Sep 23, 2025
  
  662393f2