Commits · 53e2cd464ff18adf3163949ff7b1545c7506887f · change / sglang · GitLab

"...mmclassification-0.24.1/tools/deployment/onnx2tensorrt.py" did not exist on "85529f353461ad7aa89e4d6a8cbb1a4f282e43ef"

18 Aug, 2025 1 commit
- [AMD] Reorganize hip-related header files in sgl-kernel (#9320) · c6c379ab
  Hubert Lu authored Aug 18, 2025
  
  c6c379ab
17 Aug, 2025 1 commit
- [fix]: fix cutlass moe ut and and Opt H20 cutlass groupGemm performance (#9272) · 0fc54b97
  kousakawang authored Aug 18, 2025
```
Co-authored-by: wanghanpei <wanghanpei@bytedance.com>
```
  0fc54b97
14 Aug, 2025 1 commit
- [2/n]decouple quantization implementation from vLLM dependency (#8112) · 5aa1ebd2
  Peng Zhang authored Aug 14, 2025
```
Co-authored-by: walker-ai <yiyun.wyt@antgroup.com>
Co-authored-by: leoneo <1320612015@qq.com>
```
  5aa1ebd2
13 Aug, 2025 1 commit
- [1/2][resubmit again] sgl-kernel: Fuse routed scaling factor into moe_fused_gate (#9088) · 13c48dcf
  Trevor Morris authored Aug 12, 2025
  
  13c48dcf
11 Aug, 2025 1 commit
- Revert "[1/2][resubmit] sgl-kernel: Fuse routed scaling factor into m… (#9035) · dd949ace
  Yineng Zhang authored Aug 10, 2025
  
  dd949ace
09 Aug, 2025 1 commit
- [1/2][resubmit] sgl-kernel: Fuse routed scaling factor into moe_fused_gate (select_experts) (#8770) · 591c232f
  Trevor Morris authored Aug 08, 2025
  
  591c232f
03 Aug, 2025 1 commit
- [Perf]Use Cooperative Schedule for H100 & H200 & H800 in fp8_blockwise_scaled_grouped_mm (#8722) · d9def43d
  Qi Yuhang authored Aug 03, 2025
  
  d9def43d
02 Aug, 2025 2 commits
- Revert "[1/2] sgl-kernel: Fuse routed scaling factor into select_experts" (#8706) · f9f0138f
  Liangsheng Yin authored Aug 02, 2025
  
  f9f0138f
- [1/2] sgl-kernel: Fuse routed scaling factor into select_experts (#8364) · f642524f
  Trevor Morris authored Aug 01, 2025
  
  f642524f
31 Jul, 2025 2 commits
- update sgl-kernel for EP: kernel part (#8514) · a5f5ab40
  Cheng Wan authored Jul 30, 2025
```
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
```
  a5f5ab40
- [Fix]Fix index oob in get_group_gemm_starts kernel. (#8564) · 9b9e8253
  Qi Yuhang authored Jul 31, 2025
  
  9b9e8253
30 Jul, 2025 1 commit

[Hot-Fix] moe_aligned_block_size CI failed in AMD (#8461) · 3bdcdd13

Yuan Luo authored Jul 31, 2025

Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>

3bdcdd13

28 Jul, 2025 1 commit
- Revert "[kernel] opt moe align block kernel by block/warp scan algorithm" (#8457) · 22623699
  Xiaoyu Zhang authored Jul 28, 2025
  
  22623699
17 Jul, 2025 1 commit
- [kernel] opt moe align block kernel by block/warp scan algorithm (#7884) · af1cc8fe
  Yuan Luo authored Jul 17, 2025
  
  af1cc8fe
07 Jul, 2025 1 commit
- Optimize moe align block size kernel (#7794) · a3398d84
  Ke Bao authored Jul 07, 2025
  
  a3398d84
05 Jul, 2025 3 commits
- fix: fix apply_shuffle_mul_sum (#7444) · c7973222
  Mick authored Jul 05, 2025
  
  c7973222
- Optimize Hopper CUTLASS FP8 Blockwise Grouped GEMM Kernel in Small K Scenario (#7782) · 8e9fb43d
  Qi Yuhang authored Jul 05, 2025
  
  8e9fb43d
- [1/n]: add cutlass W4A8 moe kernel for hopper architecture (#7772) · da3890e8
  SijiaYang authored Jul 05, 2025
```
Signed-off-by: yangsijia.614 <yangsijia.614@bytedance.com>
Co-authored-by: yicwang <yichen.wang@bytedance.com>
```
  da3890e8
03 Jul, 2025 2 commits
- [optimize] fuse renormalize into moe_topk_softmax (#7744) · 2998c4bd
  Yi Zhang authored Jul 04, 2025
```
Co-authored-by: ispobock <ispobaoke@gmail.com>
```
  2998c4bd
- Add CUTLASS FP8 Blockscale MoE kernel for Hopper architecture (#7278) · 2c4feaf3
  ayrnb authored Jul 03, 2025
```
Co-authored-by: HydraQYH <QYH820@Outlook.com>
Co-authored-by: TianQiLin666666 <1834987979@qq.com>
```
  2c4feaf3
02 Jul, 2025 1 commit

[1/n] apply wna16marlin kernel in moe weight only quantization (#7683) · 8e03b641

AniZpZ authored Jul 02, 2025


Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: 弋云 <yiyun.wyt@antgroup.com>
Co-authored-by: walker-ai <2398833647@qq.com>

8e03b641

25 Jun, 2025 1 commit
- Fuse sorted_token_ids padding to moe_align_block_size kernel (#7437) · 57ab7769
  Ke Bao authored Jun 25, 2025
  
  57ab7769
12 Jun, 2025 1 commit
- [sgl-kernel] Add cuda kernel for moe_ep_silu_and_mul (#6919) · 84727a51
  Yuan Luo authored Jun 12, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  84727a51
07 Jun, 2025 2 commits
- Add a CUDA kernel for fusing mapping and weighted sum for MoE. (#6916) · 3e56f557
  Elfie Guo authored Jun 07, 2025
```
Co-authored-by: Elfie Guo <elfiegxf@gmail.com>
```
  3e56f557
- reduce torch.zeros overhead in moe align block size kernel (#6369) · 8b5f83ed
  Xiaoyu Zhang authored Jun 07, 2025
  
  8b5f83ed
05 Jun, 2025 1 commit
- [EP] Add cuda kernel for moe_ep_post_reorder (#6837) · 43baba64
  Yuan Luo authored Jun 05, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  43baba64
04 Jun, 2025 3 commits
- Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts... · 81964328
  Cheng Wan authored Jun 04, 2025
```
Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts fusion is not disabled (#6736)
```
  81964328
- fix ep_moe_reorder kernel bugs (#6858) · bd75690f
  Xiaoyu Zhang authored Jun 04, 2025
```
Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>
```
  bd75690f
- [Refactor] Rename `n_share_experts_fusion` as `num_fused_shared_experts` (#6735) · 8a548052
  Cheng Wan authored Jun 03, 2025
  
  8a548052
02 Jun, 2025 2 commits
- [1/2] Add Kernel support for Cutlass based Fused FP4 MoE (#6093) · eb38c7d1
  Pavani Majety authored Jun 02, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  eb38c7d1
- [EP] Add cuda kernel for moe_ep_pre_reorder (#6699) · 55444ed6
  Yuan Luo authored Jun 02, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  55444ed6
16 May, 2025 1 commit
- [2/2] Add python wrapper for CUTLASS FP8 Blockscale MoE Kernel. (#5694) · 6fc93575
  Elfie Guo authored May 16, 2025
  
  6fc93575
23 Apr, 2025 1 commit
- [1/2] Add FP8 Blockscale MoE CUTLASS kernel for Blackwell (#5281) · e62c4955
  Elfie Guo authored Apr 22, 2025
  
  e62c4955
18 Apr, 2025 1 commit
- Sgl kernel fused_moe_gate support n_shared_experts (#5440) · 8e09b370
  Xiaoyu Zhang authored Apr 18, 2025
  
  8e09b370
10 Apr, 2025 1 commit
- reduce moe_align_block_size_kernel small batch mode overhead (#5086) · f730362e
  Xiaoyu Zhang authored Apr 10, 2025
  
  f730362e
29 Mar, 2025 1 commit
- Add deepseek style fused moe group gate selection kernel (#4530) · 45dcfc2e
  Qingquan Song authored Mar 29, 2025
  
  45dcfc2e
27 Mar, 2025 1 commit

support cmake for sgl-kernel (#4706) · 8bf6d7f4

Yineng Zhang authored Mar 27, 2025


Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: yinfan98 <1106310035@qq.com>

8bf6d7f4

14 Mar, 2025 1 commit
- Add moe topk softmax templated from vllm (#4302) · 61e4433c
  Qingquan Song authored Mar 14, 2025
  
  61e4433c
13 Mar, 2025 1 commit
- feat: support ep size < 32 for sgl kernel (#4348) · 817d4370
  Shi Shuai authored Mar 13, 2025
  
  817d4370
09 Mar, 2025 1 commit
- Rename files in sgl kernel to avoid nested folder structure (#4213) · 8abf74e3
  Lianmin Zheng authored Mar 08, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  8abf74e3