Commits · f024795e57c3589a63df2457d3d64771989d4ed7 · change / sglang · GitLab

04 Aug, 2025 2 commits
- Replace torch.jit.script with torch.compile in get_masked_input_and_mask to... · f024795e
  YyWangCS authored Aug 04, 2025
```
Replace torch.jit.script with torch.compile in get_masked_input_and_mask to fix benchmark underreporting (#8733)
```
  f024795e
- [MoE] Enable `renormalize=False` in Triton kernels (#8735) · b102353f
  Cheng Wan authored Aug 03, 2025
  
  b102353f
03 Aug, 2025 30 commits
- [CI] Do not trigger pd-disaggregation CI in draft PR (#8737) · 7a27e798
  Liangsheng Yin authored Aug 04, 2025
  
  7a27e798
- fix args typo in memory_pool_host (#8662) · 76ba5bbe
  huangtingwei authored Aug 04, 2025
  
  76ba5bbe
- Fix the missing 'lof' choice of --schedule-policy server args (#7114) · ed6f7597
  Yingchun Lai authored Aug 04, 2025
  
  ed6f7597
- feat: support cutlass_moe_fp8 kernel for fusedmoe in sm90 (#8678) · e67276ec
  tql.99 authored Aug 04, 2025
  
  e67276ec
- Fix triton kernels topk with keyword arguments (#8732) · 0242bb9c
  Ke Bao authored Aug 04, 2025
  
  0242bb9c
- use fp32 for e_score_correction_bias in GLM-4.5 (#8729) · 760286e3
  Yuxuan Zhang authored Aug 04, 2025
  
  760286e3
- [RL] fix update weight for FusedMoE with EP (#8676) · 3435a24e
  Zilin Zhu authored Aug 04, 2025
  
  3435a24e
- feat: Support DP Attention for step3_vl (#8699) · 00da9065
  yhyang201 authored Aug 03, 2025
  
  00da9065
- chore: bump v0.4.10.post2 (#8727) · 8cd34458
  Yineng Zhang authored Aug 03, 2025
  
  8cd34458
- [DP] fix the compatibility issue between DP attention and `--attention-backend triton` (#8723) · 0e0eef00
  Cheng Wan authored Aug 03, 2025
  
  0e0eef00
- [CUDA Graph] save cuda graph memory by using next_token_logits_buffer (#8579) · cb099d20
  Cheng Wan authored Aug 03, 2025
  
  cb099d20
- Save cuda graph memory for fa3 (#8567) · 7a913301
  Cheng Wan authored Aug 03, 2025
  
  7a913301
- chore: bump sgl-kernel 0.3.0 with torch 2.8.0 (#8718) · 5ce5093b
  Yineng Zhang authored Aug 03, 2025
  
  5ce5093b
- [Improvements] Merge health check route (#8444) · 6f9baf10
  ybyang authored Aug 03, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  6f9baf10
- feat: Add new moe triton for NVIDIA RTX 6000 Ada (#8547) · a31b7a70
  Jasper James authored Aug 03, 2025
  
  a31b7a70
- [fix] Fix divide by zero error for llama4. (#8683) · 7ed8e51b
  Varun Vinayak Shenoy authored Aug 03, 2025
  
  7ed8e51b
- Do layernorm before allgather for DP attention (#8631) · 32f28154
  Trevor Morris authored Aug 03, 2025
  
  32f28154
- [feat] support minimum token load balance in dp attention (#7379) · f7b2853f
  Guanhua Wang authored Aug 03, 2025
  
  f7b2853f
- HiCache storage, style change and bug fix (#8719) · b0add2da
  Zhiqiang Xie authored Aug 03, 2025
  
  b0add2da
- Reduce memory accumulation in long-running server (#8306) · 0305c505
  Wenxuan Tan authored Aug 03, 2025
```
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
```
  0305c505
- Support limiting max loaded loras in CPU. (#8650) · 8675bdf2
  Lifu Huang authored Aug 03, 2025
  
  8675bdf2
- [hotfix] fix mixtral with tensor-level compressed-tensor quantization (#8721) · a437aa99
  Cheng Wan authored Aug 02, 2025
  
  a437aa99
- Tiny fix CI pytest error (#8524) · 0e612dbf
  fzyzcjy authored Aug 03, 2025
  
  0e612dbf
- Fix fused MoE when `routed_scaling_factor is None` (#8709) · 9f47d686
  Liangsheng Yin authored Aug 03, 2025
  
  9f47d686
- [Perf]Use Cooperative Schedule for H100 & H200 & H800 in fp8_blockwise_scaled_grouped_mm (#8722) · d9def43d
  Qi Yuhang authored Aug 03, 2025
  
  d9def43d
- [Feature] Radix Tree in C++ (#7369) · e273aa6d
  DarkSharpness authored Aug 02, 2025
  
  e273aa6d
- [router] Implement HTTP Dependency Injection Pattern for Router System (#8714) · 828a4fe9
  Simo Lin authored Aug 02, 2025
  
  828a4fe9
- Fix triton moe error caused by TopK refactor (#8705) · 8ada1ab6
  fzyzcjy authored Aug 03, 2025
  
  8ada1ab6
- [FIX] Fix the nightly CI by disabling swa mem pool for gemma2 (#8693) · e314b084
  Lianmin Zheng authored Aug 02, 2025
  
  e314b084
- Remove assertions about per group quant fp8 (#8717) · 403566bc
  fzyzcjy authored Aug 03, 2025
  
  403566bc
02 Aug, 2025 8 commits
- chore: bump sgl-kernel v0.2.9 (#8713) · 0a56b721
  Yineng Zhang authored Aug 02, 2025
  
  0a56b721
- [Bug] fix green context's incompatibility with `cuda < 12.4` (#8701) · 603f5ce0
  Liangsheng Yin authored Aug 03, 2025
  
  603f5ce0
- [router] minor code clean up and and refactoring (#8711) · 6d4fd882
  Simo Lin authored Aug 02, 2025
  
  6d4fd882
- Revert "[1/2] sgl-kernel: Fuse routed scaling factor into select_experts" (#8706) · f9f0138f
  Liangsheng Yin authored Aug 02, 2025
  
  f9f0138f
- [Doc] Polish sgl-kernel readme for cu126 build error (#8704) · ac6962cc
  PGFLMG authored Aug 02, 2025
  
  ac6962cc
- Add tensor.detach() back to update weight util (#8691) · 4ca43b06
  Stefan He authored Aug 02, 2025
  
  4ca43b06
- model: adapt mllama4 to VisionAttention (#8512) · ea93079b
  Wenchen Lo authored Aug 02, 2025
```
Co-authored-by: root <mickjagger19@icloud.com>
```
  ea93079b
- Fix: resolve prefill of retracted request out-of-memory issue when ignore_eos is enabled (#7434) · 4bec99ec
  Yusong Gao authored Aug 02, 2025
  
  4bec99ec