Commits · 84b30d9e0012e724f320dd4f23bdf2a86fbf2a4c · change / sglang · GitLab

17 Aug, 2025 23 commits
- Set the default attention backend for GLM-4.5v to fa3 (#9245) · 84b30d9e
  zifeitong authored Aug 17, 2025
  
  84b30d9e
- [router] introducing tokenizer trait (#9287) · ff0cf51c
  Simo Lin authored Aug 17, 2025
  
  ff0cf51c
- chore: bump sgl-kernel v0.3.6.post1 (#9286) · a1c7f742
  Yineng Zhang authored Aug 17, 2025
  
  a1c7f742
- [CPU] Fix TP padding issue on Phi-4 (#8289) · ebbb75e9
  blzheng authored Aug 18, 2025
  
  ebbb75e9
- [router] introduce prefill response draining for http compliance (#9281) · b341b7db
  Simo Lin authored Aug 17, 2025
  
  b341b7db
- Tiny make fp4 moe method parameters more static (#8520) · b498cd21
  fzyzcjy authored Aug 18, 2025
  
  b498cd21
- [fix]: fix cutlass moe ut and and Opt H20 cutlass groupGemm performance (#9272) · 0fc54b97
  kousakawang authored Aug 18, 2025
```
Co-authored-by: wanghanpei <wanghanpei@bytedance.com>
```
  0fc54b97
- Fix memory pool leak error (#9271) · b3c1f2e4
  fzyzcjy authored Aug 18, 2025
  
  b3c1f2e4
- Fix swa eagle verify accuracy for Triton backend (#9279) · be1a3cd9
  Ke Bao authored Aug 18, 2025
  
  be1a3cd9
- [chore] Clean up redundant lora_weight_names concept to simplify code (#9131) · 4b74c3fc
  Lifu Huang authored Aug 17, 2025
  
  4b74c3fc
- [router] add cargo clippy in CI and fix-up linting errors (#9242) · ce3ca9b0
  Jeff Nettleton authored Aug 17, 2025
  
  ce3ca9b0
- Revert "[Misc] feat: Deepgemm update for sgl-kernel (#8790)" to fix kernel CI (#9260) · 4d98e486
  Liangsheng Yin authored Aug 17, 2025
  
  4d98e486
- `from python.sglang.srt` -> `from sglang.srt` (#9268) · 3d77a318
  Netanel Haber authored Aug 17, 2025
  
  3d77a318
- model: support nvidia/Llama-3_3-Nemotron-Super-49B-v1 (#9067) · 845d12a9
  Netanel Haber authored Aug 17, 2025
```
Co-authored-by: Kyle Huang <kylhuang@nvidia.com>
```
  845d12a9
- Quick Fix GLM (#9264) · e47800e1
  Stefan He authored Aug 16, 2025
  
  e47800e1
- [router] fix pd prefill http request complinace issue (#9237) · bb10e3a1
  Simo Lin authored Aug 16, 2025
  
  bb10e3a1
- [Bugfix] Change vLLM install order & Add A2 support (#9232) · fda762a2
  Even Zhou authored Aug 17, 2025
  
  fda762a2
- ci: simplify multi-modality tests by using mixins (#9006) · 1df84ff4
  Mick authored Aug 17, 2025
  
  1df84ff4
- Bug fix: use correct mm_items in embed_mm_inputs (#8893) · 66d6be08
  Binyao Jiang authored Aug 16, 2025
  
  66d6be08
- Combine fp4.py and mxfp4.py into one file and support dynamic mxfp4... · 1c1f8a11
  kk authored Aug 17, 2025
```
Combine fp4.py and mxfp4.py into one file and support dynamic mxfp4 quantization in mxfp4.py (#9049)
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  1c1f8a11
- [PD] Support PD disaggregation with Prefill PP (#8846) · 384f8ab5
  Shangming Cai authored Aug 17, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: root <huzhiyuan@xiaohongshu.com>
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Francis <38564764+ssssnow@users.noreply.github.com>
Co-authored-by: zitto <zhjc1124@gmail.com>
```
  384f8ab5
- fix unexcepted answer in EAGLE mode (#9252) · 6a9d6ca3
  zyksir authored Aug 17, 2025
  
  6a9d6ca3
- [feature] Ascend NPU graph support (#8027) · 94371dbb
  VDV1985 authored Aug 17, 2025
```
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: yezhifeng (D) <y00897525@china.huawei.com>
Co-authored-by: anon189Ty <Stari_Falcon@outlook.com>
Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>
```
  94371dbb
16 Aug, 2025 6 commits
- Fix Custom All Reduce CI job. (#9258) · 740f0630
  Sai Enduri authored Aug 16, 2025
  
  740f0630
- [CI] add deepseek w4a8 test on h20 ci (#7758) · 81da16f6
  Hank Han authored Aug 16, 2025
  
  81da16f6
- Fix DP load for embedding (#9165) · bc938ea1
  Brayden Zhong authored Aug 16, 2025
  
  bc938ea1
- Add fp4 quantize before all-gather for Flashinfer cutlass MoE DP (max throughput) (#7667) · eff4eb3f
  Trevor Morris authored Aug 15, 2025
  
  eff4eb3f
- Revert "chore: bump sgl-kernel v0.3.6 (#9220)" (#9247) · 87dab548
  Yineng Zhang authored Aug 15, 2025
  
  87dab548
- Revert "chore(docker): update sgl_kernel version to 0.3.6 in Dockerfi… (#9246) · 5121af46
  Yineng Zhang authored Aug 15, 2025
  
  5121af46
15 Aug, 2025 11 commits
- Fix nan value generated after custom all reduce (#8663) · 983aa496
  kk authored Aug 16, 2025
```
Co-authored-by: wunhuang <wunhuang@amd.com>
```
  983aa496
- [AMD] Expand test coverage for AMD CI and enable... · 9c3e95d9
  Hubert Lu authored Aug 15, 2025
```
[AMD] Expand test coverage for AMD CI and enable apply_token_bitmask_inplace_cuda in sgl-kernel (#8268)
```
  9c3e95d9
- chore(docker): update sgl_kernel version to 0.3.6 in Dockerfile.gb200 (#9243) · e52c3866
  ishandhanani authored Aug 15, 2025
  
  e52c3866
- [router] preserve original worker response header in router (#9236) · da53e13c
  Simo Lin authored Aug 15, 2025
  
  da53e13c
- [router] clean up lint warnings with clippy execution (#9201) · d7e38b2f
  Jeff Nettleton authored Aug 15, 2025
  
  d7e38b2f
- [router] allow more health check configuration (#9198) · 21b88460
  Simo Lin authored Aug 15, 2025
  
  21b88460
- Optional extension for green context (#9231) · 0c8594e6
  Liangsheng Yin authored Aug 15, 2025
  
  0c8594e6
- chore: bump sgl-kernel v0.3.6 (#9220) · c186feed
  Yineng Zhang authored Aug 15, 2025
  
  c186feed
- Cleanup MoE Refactor (#9223) · 84b006b2
  Cheng Wan authored Aug 15, 2025
  
  84b006b2
- [CI] Fix sgl-router disaggregation test (#9222) · 8ca07bd9
  Shangming Cai authored Aug 15, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  8ca07bd9
- Fp4 MOE quant kernel optimization (#8777) · 4fc09e0d
  jy-song-hub authored Aug 15, 2025
```
Co-authored-by: Rain Jiang <96632942+rainj-me@users.noreply.github.com>
```
  4fc09e0d