Commits · 780d6a22cd2e2ad6dd3ee6f92ed0da3d74c5c3e3 · change / sglang

"template/testdata/magicoder.gotmpl/user-assistant-user" did not exist on "326363b3a72d9e2972a019dfc4c6147ea901f501"

19 Sep, 2025 7 commits
- [router] refactor worker to builder pattern 2/n (#10633) · 780d6a22
  Simo Lin authored Sep 19, 2025
  
  780d6a22
- Hicache L3 backend mooncake optimization configuration reading method (#10319) · 8b713c72
  FlyPanda authored Sep 19, 2025
```
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: shicang <shicang@shicang>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  8b713c72
- chore: bump sgl-kernel 0.3.11 (#10630) · 5bfafdfc
  Yineng Zhang authored Sep 18, 2025
  
  5bfafdfc
- feat: add fused moe config for Qwen3-Next-80B-A3B-Instruct on B200 (#10631) · 8c52de6f
  zixuanzhang226 authored Sep 18, 2025
  
  8c52de6f
- model support: Sarashina2VisionForCausalLM (#10632) · c1815a99
  Chang Su authored Sep 18, 2025
  
  c1815a99
- [Performance] Qwen3-Next: speed up update_mamba_state_after_mtp_verify by 10x;... · 4e6c4923
  Binyao Jiang authored Sep 18, 2025
```
[Performance] Qwen3-Next: speed up update_mamba_state_after_mtp_verify by 10x; e2e up to 3.54% faster (#10586)
```
  4e6c4923
- [Performance] Qwen3-Next: replace arange to cached query_start_loc_li… (#10553) · b91cb67e
  Binyao Jiang authored Sep 18, 2025
  
  b91cb67e
18 Sep, 2025 20 commits
- [Feature] Speculative decoding support lookahead (#9873) · e7bc6003
  Zhihao Zhang authored Sep 19, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  e7bc6003
- refactor: use registry for _get_attention_backend_from_str (#10629) · 2a2ff9a8
  Yineng Zhang authored Sep 18, 2025
  
  2a2ff9a8
- [router] refactor worker to builder pattern 1/n (#10628) · 5291f32d
  Simo Lin authored Sep 18, 2025
  
  5291f32d
- Garbage collector regression in the online server (#10621) · 67073dde
  brayden-hai authored Sep 18, 2025
  
  67073dde
- feat: Add FlexAttention Backend for Efficient Sparse Attention (#9947) · 9a5c42f9
  yuk.igalaxy authored Sep 19, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  9a5c42f9
- Fix bias handling in TritonMoeQuantInfo within quantization/mxfp4.py (#10579) · 388c05d5
  yhyang201 authored Sep 19, 2025
  
  388c05d5
- [Performance] qwen3-next improve causal conv1d in prefill phase (#10595) · fc809665
  Jinyan Chen authored Sep 19, 2025
```
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
```
  fc809665
- Fix sgl_kernel import failure on devices other than CUDA (#10610) · 6fd4816d
  Zaili Wang authored Sep 19, 2025
  
  6fd4816d
- support qwen3-next-fp8 deepep (#10622) · 1344ebc8
  Yi Zhang authored Sep 19, 2025
  
  1344ebc8
- update deepep version for qwen3-next deepep moe (#10624) · e07b21ce
  Yi Zhang authored Sep 19, 2025
  
  e07b21ce
- Feat/add heartbeat mechanism for nixl conn (#10222) · 52f248cd
  shaharmor98 authored Sep 18, 2025
```
Signed-off-by: Shahar Mor <smor@nvidia.com>
```
  52f248cd
- [RL] Add destroy process group api (#9979) · 93f75778
  penguin_wwy authored Sep 19, 2025
  
  93f75778
- fix deepep assert when PD disaggregation == null (#8274) · 4039c626
  AlphaBaby authored Sep 19, 2025
```
Co-authored-by: fujianhao.fjh <fujianhao.fjh@antgroup.com>
```
  4039c626
- Scale kkt after reduction (#10604) · db71c38f
  Yi Zhang authored Sep 18, 2025
  
  db71c38f
- [improvement] add average input/output token length for hicache benchmark stats output (#10525) · 7a68b422
  zhannngchen authored Sep 18, 2025
  
  7a68b422
- chore: upgrade mooncake 0.3.6 (#10596) · 60fc5b51
  Shangming Cai authored Sep 18, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  60fc5b51
- [PD] Improve disaggregation common backend and refactor mooncake backend (#10273) · a13dd1e4
  Shangming Cai authored Sep 18, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  a13dd1e4
- aiter v0.1.5.post2 (#10563) · d500eb91
  HAI authored Sep 17, 2025
  
  d500eb91
- [HICache] introduce evict policy (#10190) · 1ccd59c7
  Xuchun Shang authored Sep 18, 2025
```
Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
```
  1ccd59c7
- [ROCm] Fix fp8 quantization accuracy issue. (#10558) · c32fb7a2
  sogalin authored Sep 18, 2025
  
  c32fb7a2
17 Sep, 2025 13 commits
- Enable trtllm mla prefix extend (#10526) · 1ba137e9
  Shu Wang authored Sep 17, 2025
  
  1ba137e9
- vlm: remove redundant d2h movement of mm feature tensors (#9987) · de28f8e7
  Kevin Xiang Li authored Sep 17, 2025
```
Co-authored-by: Xiang (Kevin) Li <lik@nvidia.com>
```
  de28f8e7
- fix: update dsv3 fp4 ut (#10584) · 56405076
  Yineng Zhang authored Sep 17, 2025
  
  56405076
- [BugFix] Fix incorrect hidden_states_tensor in pd disaggregation + eagle (#9976) · b73ac629
  Ziming Huang authored Sep 18, 2025
  
  b73ac629
- [HiCache] Add tests for hicache storage mooncake backend (#10171) · 77098aea
  Teng Ma authored Sep 18, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  77098aea
- [bench] Fix random seed in `bench_one_batch_server` (#10548) · 5ccf0b03
  Liangsheng Yin authored Sep 17, 2025
  
  5ccf0b03
- CUDA Arch Independent (#8813) · a77564e0
  EduardDurech authored Sep 17, 2025
  
  a77564e0
- Remove duplicated code (#10545) · 4f9e71df
  Yichen Yan authored Sep 17, 2025
```
Co-authored-by: jiapingW <56055330+jiapingW@users.noreply.github.com>
```
  4f9e71df
- [bugfix]hicache bench_long_context.py run failed (#10523) · 541551ce
  zhannngchen authored Sep 17, 2025
  
  541551ce
- enable prefix cache with dp (#10459) · 124097fc
  Shu Wang authored Sep 16, 2025
  
  124097fc
- Fix decord dependency for aarch64 docker build (#10529) · e1d45bc2
  kyleliang-nv authored Sep 16, 2025
  
  e1d45bc2
- feat: add priority based scheduling with priority based request acceptance and preemption (#8746) · 14fdd527
  harrisonlimh authored Sep 16, 2025
  
  14fdd527
- [Auto Sync] Update activation.py, chunk_cache.py, utils.py (20250917) (#10538) · f949ad57
  Lianmin Zheng authored Sep 16, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
```
  f949ad57