Commits · bf72b80122fd888bf619d17b96fa3e323ab809fc · change / sglang · GitLab

09 Sep, 2025 26 commits
- [Auto Sync] Update io_struct.py (20250909) (#10236) · bf72b801
  Lianmin Zheng authored Sep 09, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
```
  bf72b801
- Add mamba kernel (#10234) · 8cbe1538
  Yi Zhang authored Sep 10, 2025
  
  8cbe1538
- [HiCache] feat: add mooncake backend extra config (#10213) · 8471e5e6
  Teng Ma authored Sep 10, 2025
  
  8471e5e6
- Revert "Revert the changes on NCCL symmetric memory" (#10238) · 4582931a
  Lianmin Zheng authored Sep 09, 2025
  
  4582931a
- Revert the changes on NCCL symmetric memory (#10210) · d352c29a
  Lianmin Zheng authored Sep 09, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  d352c29a
- chore: upgrade v0.3.9 sgl-kernel (#10220) · d3ee7098
  Yineng Zhang authored Sep 09, 2025
  
  d3ee7098
- [Fix] KV-cache eviction mismatch across PP ranks in DeepSeek V3/R1 (#10214) · 71fc7b7f
  Rain H authored Sep 09, 2025
  
  71fc7b7f
- add variable TP Decode > Prefill size support (#9960) · 9ab72f98
  shaharmor98 authored Sep 09, 2025
```
Signed-off-by: Shahar Mor <smor@nvidia.com>
```
  9ab72f98
- chore: bump v0.3.9 sgl-kernel (#10208) · f3817cb0
  Yineng Zhang authored Sep 09, 2025
  
  f3817cb0
- [Auto Sync] Update sampling_batch_info.py (20250909) (#10212) · 71133a04
  Lianmin Zheng authored Sep 09, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
```
  71133a04
- tool-call(dsv3): Fixed a parse problem when there are multiple function... · 2cd94dd0
  Yiming authored Sep 09, 2025
```
tool-call(dsv3): Fixed a parse problem when there are multiple function definitions in tool_calls (#10209)
```
  2cd94dd0
- Refactor fused_add_rmsnorm import logic (#10207) · f5f6b3b4
  Shangming Cai authored Sep 09, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  f5f6b3b4
- feat: support fa cute in sgl-kernel (#10205) · 94fb4e9e
  Yineng Zhang authored Sep 09, 2025
```
Co-authored-by: cicirori <32845984+cicirori@users.noreply.github.com>
```
  94fb4e9e
- [CPU] Add gelu_and_mul kernel in sgl-kernel and add ut (#9300) · d1d4074c
  blzheng authored Sep 09, 2025
  
  d1d4074c
- Explicitly export CMAKE_BUILD_PARALLEL_LEVEL (#10193) · 718f25ae
  Keyang Ru authored Sep 08, 2025
  
  718f25ae
- [Refactor] Remove Hicache Load & Write threads (#10127) · 948b01a0
  DarkSharpness authored Sep 08, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  948b01a0
- feat: use sgl-kernel cu129 as default (#10188) · cdc56ef6
  Yineng Zhang authored Sep 08, 2025
  
  cdc56ef6
- Support opt model (#10165) · 16ff3d4b
  wenhuipeng authored Sep 09, 2025
  
  16ff3d4b
- [1/N]DP refactor: Improve dp rank scheduling in PD disaggregation mode. (#10169) · 83d55ac5
  Liangsheng Yin authored Sep 09, 2025
  
  83d55ac5
- Updated Nvidia Jetson docs (#4422) · 2fe17735
  Shakhizat Nurgaliyev authored Sep 09, 2025
  
  2fe17735
- [CPU] Fix phi4-mm prompt issue in bench_serving (#9900) · 97fff98c
  blzheng authored Sep 09, 2025
  
  97fff98c
- Update link for EAGLE speculative decoding (#10191) · ba066ca0
  geray authored Sep 09, 2025
  
  ba066ca0
- [Fix] Orphan process in data parallel (#7995) · 96784a65
  Caproni authored Sep 09, 2025
```
Signed-off-by: Capronir <839972205@qq.com>
```
  96784a65
- Revert "feat: add fused moe config for Qwen3-30B-A3B on B200" (#10185) · df5407fb
  Rain Jiang authored Sep 08, 2025
  
  df5407fb
- Cleaning codes for speculative attention mode (#10149) · 8ad700f7
  Baizhou Zhang authored Sep 08, 2025
  
  8ad700f7
- gb200: update dockerfile to latest kernel (#9522) · 148022fc
  ishandhanani authored Sep 08, 2025
  
  148022fc
08 Sep, 2025 14 commits
- fix the cutlass moe tests (#10182) · 7a40e4f4
  Rain Jiang authored Sep 08, 2025
  
  7a40e4f4
- fix: resolve lint issue (#10181) · 19d64f2b
  Yineng Zhang authored Sep 08, 2025
  
  19d64f2b
- [Bench] feat: mooncake trace integration (#9839) · a02071a1
  Teng Ma authored Sep 09, 2025
```
Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Signed-off-by: Teng Ma <sima.mt@alibaba-inc.com>
Co-authored-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
```
  a02071a1
- Revert "[ModelOpt] Fix Weight Loading for DSR1-FP4 Quantization (#9712)" (#10176) · 45b3a6a2
  Yineng Zhang authored Sep 08, 2025
  
  45b3a6a2
- [fix] Relax white space rules in EBNFComposer (#9595) · 9a18aa54
  LukasBluebaum authored Sep 08, 2025
  
  9a18aa54
- pref: Add H20 fp8 fused MoE kernel configs for Qwen3 (#10166) · 91f0fd95
  Zhiy-Zhang authored Sep 09, 2025
```
Co-authored-by: qiufan.zzy <qiufan.zzy@antgroup.com>
```
  91f0fd95
- [Bug fix] Fix ascend mla in aclgraph (#9925) · 8085aca7
  alanhe151220037 authored Sep 09, 2025
  
  8085aca7
- [1/2] Speed up prefill mla attention (#10156) · 0096798e
  fzyzcjy authored Sep 09, 2025
  
  0096798e
- [CI] fix ambiguous argument in testing hybrid attentions. (#10161) · 2c2b19b1
  Liangsheng Yin authored Sep 08, 2025
  
  2c2b19b1
- Monkey patch uvicorn multi worker `is_alive` timeout (#10159) · 72f9fc5f
  Liangsheng Yin authored Sep 08, 2025
```
Co-authored-by: Huang Long <121648372+llll114@users.noreply.github.com>
```
  72f9fc5f
- [Hicache]: Add E2E CI For 3FS-KVStore (#10131) · ec99668a
  hzh0425 authored Sep 08, 2025
  
  ec99668a
- [1/N] DP-Refactor: move communicators into `tokenizer_communicator_mixin` (#10028) · 78f13981
  Liangsheng Yin authored Sep 08, 2025
  
  78f13981
- update xgrammar 0.1.24 and transformers 4.56.1 (#10155) · bfd7a18d
  Swipe4057 authored Sep 08, 2025
  
  bfd7a18d
- [Bug fix] Fix Gemma 2 and fix Gemma 3 multimodal with bs > 1 on NPU (#9871) · 5dd8c644
  ssshinigami authored Sep 08, 2025
```
Co-authored-by: Maksim <makcum888e@mail.ru>
```
  5dd8c644