Commits · d1d4074c4e1f0c890b82b59d583f08350080f594 · change / sglang · GitLab

09 Sep, 2025 8 commits
- [CPU] Add gelu_and_mul kernel in sgl-kernel and add ut (#9300) · d1d4074c
  blzheng authored Sep 09, 2025
  
  d1d4074c
- [Refactor] Remove Hicache Load & Write threads (#10127) · 948b01a0
  DarkSharpness authored Sep 08, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  948b01a0
- Support opt model (#10165) · 16ff3d4b
  wenhuipeng authored Sep 09, 2025
  
  16ff3d4b
- [1/N]DP refactor: Improve dp rank scheduling in PD disaggregation mode. (#10169) · 83d55ac5
  Liangsheng Yin authored Sep 09, 2025
  
  83d55ac5
- [CPU] Fix phi4-mm prompt issue in bench_serving (#9900) · 97fff98c
  blzheng authored Sep 09, 2025
  
  97fff98c
- [Fix] Orphan process in data parallel (#7995) · 96784a65
  Caproni authored Sep 09, 2025
```
Signed-off-by: Capronir <839972205@qq.com>
```
  96784a65
- Revert "feat: add fused moe config for Qwen3-30B-A3B on B200" (#10185) · df5407fb
  Rain Jiang authored Sep 08, 2025
  
  df5407fb
- Cleaning codes for speculative attention mode (#10149) · 8ad700f7
  Baizhou Zhang authored Sep 08, 2025
  
  8ad700f7
08 Sep, 2025 28 commits
- fix the cutlass moe tests (#10182) · 7a40e4f4
  Rain Jiang authored Sep 08, 2025
  
  7a40e4f4
- fix: resolve lint issue (#10181) · 19d64f2b
  Yineng Zhang authored Sep 08, 2025
  
  19d64f2b
- [Bench] feat: mooncake trace integration (#9839) · a02071a1
  Teng Ma authored Sep 09, 2025
```
Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Signed-off-by: Teng Ma <sima.mt@alibaba-inc.com>
Co-authored-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
```
  a02071a1
- Revert "[ModelOpt] Fix Weight Loading for DSR1-FP4 Quantization (#9712)" (#10176) · 45b3a6a2
  Yineng Zhang authored Sep 08, 2025
  
  45b3a6a2
- [fix] Relax white space rules in EBNFComposer (#9595) · 9a18aa54
  LukasBluebaum authored Sep 08, 2025
  
  9a18aa54
- pref: Add H20 fp8 fused MoE kernel configs for Qwen3 (#10166) · 91f0fd95
  Zhiy-Zhang authored Sep 09, 2025
```
Co-authored-by: qiufan.zzy <qiufan.zzy@antgroup.com>
```
  91f0fd95
- [Bug fix] Fix ascend mla in aclgraph (#9925) · 8085aca7
  alanhe151220037 authored Sep 09, 2025
  
  8085aca7
- Monkey patch uvicorn multi worker `is_alive` timeout (#10159) · 72f9fc5f
  Liangsheng Yin authored Sep 08, 2025
```
Co-authored-by: Huang Long <121648372+llll114@users.noreply.github.com>
```
  72f9fc5f
- [Hicache]: Add E2E CI For 3FS-KVStore (#10131) · ec99668a
  hzh0425 authored Sep 08, 2025
  
  ec99668a
- [1/N] DP-Refactor: move communicators into `tokenizer_communicator_mixin` (#10028) · 78f13981
  Liangsheng Yin authored Sep 08, 2025
  
  78f13981
- update xgrammar 0.1.24 and transformers 4.56.1 (#10155) · bfd7a18d
  Swipe4057 authored Sep 08, 2025
  
  bfd7a18d
- [Bug fix] Fix Gemma 2 and fix Gemma 3 multimodal with bs > 1 on NPU (#9871) · 5dd8c644
  ssshinigami authored Sep 08, 2025
```
Co-authored-by: Maksim <makcum888e@mail.ru>
```
  5dd8c644
- enable llama3.1-8B on xpu (#9434) · ee21817c
  Huaiyu, Zheng authored Sep 08, 2025
  
  ee21817c
- Revert "enable auto-round quantization model (#6226)" (#10148) · b7d1f17b
  Yineng Zhang authored Sep 07, 2025
  
  b7d1f17b
- enable auto-round quantization model (#6226) · c8295d23
  Weiwei authored Sep 08, 2025
```
Signed-off-by: Zhang, Weiwei1 <weiwei1.zhang@intel.com>
```
  c8295d23
- [Bugfix] Qwen3MoE aclrtMemcpy failed with NPUGraph (#10013) · b67c277f
  Even Zhou authored Sep 08, 2025
  
  b67c277f
- Fix: (glm4v) Add missing field (#10147) · 8116804e
  Xinyuan Tong authored Sep 08, 2025
  
  8116804e
- Add speculator attention backend switch (#9981) · 8c5930f0
  cicirori authored Sep 08, 2025
  
  8c5930f0
- [Bugfix] Retract not releasing enough memory when page size > 1 (#9989) · 3b99f23c
  Zhiqiang Xie authored Sep 07, 2025
  
  3b99f23c
- Add graph runner support with torch compile on CPU (#7843) · 7577f0e4
  Cao E authored Sep 08, 2025
  
  7577f0e4
- Standalone speculative decoding (#10090) · 8cda5a62
  Qiaolin Yu authored Sep 07, 2025
  
  8cda5a62
- Fix run time error in dsv3-fp8 model on mi35x (#10104) · 400d3b97
  kk authored Sep 08, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  400d3b97
- Qwen2.5-VL eagle3 infer (#8801) · 37d83c6e
  Lzhang-hub authored Sep 08, 2025
  
  37d83c6e
- fix the fp8 topk_config.correction_bias is none bug (#10040) · 7802586c
  Rain Jiang authored Sep 07, 2025
  
  7802586c
- Fix slow fused add RMSNorm (#10141) · bc5fc332
  fzyzcjy authored Sep 08, 2025
  
  bc5fc332
- vlm: enable GLM4.1V server testing & fix video processing (#10095) · f3440adc
  Xinyuan Tong authored Sep 08, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
```
  f3440adc
- [MoE] fix: incorrect weight initialization for cutlass_fused_experts_fp8 (#10144) · 5a7e10fe
  Cheng Wan authored Sep 07, 2025
  
  5a7e10fe
- [BUG FIX] add fail check when get fail in case wait complete block (#9971) · 33467c05
  Shisong Ma authored Sep 08, 2025
```
Co-authored-by: mashisong <mashisong@bytedance.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  33467c05
07 Sep, 2025 4 commits
- Fix flashinfer version in sgl-kernel (#10135) · 76a2c86b
  Lianmin Zheng authored Sep 07, 2025
  
  76a2c86b
- [1/2] Refactor multi-tokenizer manager (#10074) · e719bb0e
  Liangsheng Yin authored Sep 07, 2025
  
  e719bb0e
- [Minor] fix lint in main (#10128) · 06724683
  DarkSharpness authored Sep 07, 2025
  
  06724683
- [Auto Sync] Update parallel_state.py (20250907) (#10126) · 617aa2b2
  Lianmin Zheng authored Sep 07, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: jzhou-xai <jzhou@x.ai>
```
  617aa2b2