Commits · 616a3e20df5faf73a7d1581c7016413f64d583e4 · change / sglang

19 Sep, 2025 1 commit

[sgl-kernel] Support moe_sum_reduce cuda kernel (#10321) · 616a3e20

Yuan Luo authored Sep 19, 2025


Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>

616a3e20

18 Sep, 2025 1 commit
- [Feature] Speculative decoding support lookahead (#9873) · e7bc6003
  Zhihao Zhang authored Sep 19, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  e7bc6003
16 Sep, 2025 1 commit
- Update CUTLASS. Refine KernelSchedule for fp8 (grouped) gemm. (#10491) · 9b876889
  Qi Yuhang authored Sep 16, 2025
  
  9b876889
14 Sep, 2025 1 commit
- fix: use latest flashinfer (#10428) · 55025b92
  Yineng Zhang authored Sep 14, 2025
  
  55025b92
13 Sep, 2025 1 commit
- Fix the style of sgl kernel (#10398) · c9ec4cae
  Lianmin Zheng authored Sep 12, 2025
  
  c9ec4cae
11 Sep, 2025 1 commit
- Revert "Fix flashinfer version in sgl-kernel (#10135)" (#10310) · de15d140
  Yineng Zhang authored Sep 11, 2025
  
  de15d140
09 Sep, 2025 2 commits
- Add mamba kernel (#10234) · 8cbe1538
  Yi Zhang authored Sep 10, 2025
  
  8cbe1538
- feat: support fa cute in sgl-kernel (#10205) · 94fb4e9e
  Yineng Zhang authored Sep 09, 2025
```
Co-authored-by: cicirori <32845984+cicirori@users.noreply.github.com>
```
  94fb4e9e
08 Sep, 2025 2 commits
- [1/2] Speed up prefill mla attention (#10156) · 0096798e
  fzyzcjy authored Sep 09, 2025
  
  0096798e
- move compile threads to an option to avoid OOM on low memory host (#10123) · 6049ca20
  Rain Jiang authored Sep 07, 2025
  
  6049ca20
07 Sep, 2025 1 commit
- Fix flashinfer version in sgl-kernel (#10135) · 76a2c86b
  Lianmin Zheng authored Sep 07, 2025
  
  76a2c86b
06 Sep, 2025 2 commits
- [chore] Remove unused ep_moe cuda kernels (#9956) · 5f1eb204
  hlu1 authored Sep 06, 2025
  
  5f1eb204
- Remove non-accelerated targets(100 and up) from cmake (#10041) · 039cef76
  hlu1 authored Sep 06, 2025
```
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
```
  039cef76
05 Sep, 2025 1 commit
- Support copying tensor from cpu to gpu without using copy engines (#10007) · bd7f8821
  fzyzcjy authored Sep 05, 2025
  
  bd7f8821
03 Sep, 2025 1 commit
- Remove annoying warnings in sgl kernel build (#9905) · d631290e
  Lianmin Zheng authored Sep 02, 2025
  
  d631290e
30 Aug, 2025 1 commit
- [sgl-kernel] fix: fix missing FetchContent_Populate for fmt (#9826) · 7fe89f7c
  PGFLMG authored Aug 31, 2025
  
  7fe89f7c
28 Aug, 2025 1 commit
- Support compile sgl-kernel on cuda 13.0 (#9721) · 6b39f9cf
  Rain Jiang authored Aug 28, 2025
  
  6b39f9cf
27 Aug, 2025 2 commits
- [sgl-kernel] misc: update deepgemm version for sgl-kernel (#9340) · aa3eba8e
  PGFLMG authored Aug 28, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
```
  aa3eba8e
- support cuda 13.0 and trtllm kernel by Aug 25 2025 (#9495) · 79e6a8a6
  Rain Jiang authored Aug 26, 2025
  
  79e6a8a6
25 Aug, 2025 1 commit
- Update CUTLASS 4.2 & Enable K-Major Scale Factor for SM90 FP8 Blockwise Group GEMM (#9559) · fda47926
  Qi Yuhang authored Aug 25, 2025
  
  fda47926
19 Aug, 2025 1 commit
- Add `CMakeLists.txt` binary_dir (#7019) · 720cd308
  EduardDurech authored Aug 19, 2025
  
  720cd308
18 Aug, 2025 1 commit
- Minor style fixes for sgl-kernel (#9289) · c480a3f6
  Lianmin Zheng authored Aug 18, 2025
  
  c480a3f6
17 Aug, 2025 1 commit
- Revert "[Misc] feat: Deepgemm update for sgl-kernel (#8790)" to fix kernel CI (#9260) · 4d98e486
  Liangsheng Yin authored Aug 17, 2025
  
  4d98e486
15 Aug, 2025 4 commits
- Optional extension for green context (#9231) · 0c8594e6
  Liangsheng Yin authored Aug 15, 2025
  
  0c8594e6
- [Misc] feat: Deepgemm update for sgl-kernel (#8790) · a3d99d6d
  PGFLMG authored Aug 15, 2025
  
  a3d99d6d
- feat: remove sm75 (#9207) · 9d54c6e6
  Yineng Zhang authored Aug 14, 2025
  
  9d54c6e6
- use fast math for per_token_group_quant_8bit. (#9177) · 1f9d65f5
  strgrb authored Aug 15, 2025
```
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
```
  1f9d65f5
14 Aug, 2025 1 commit
- [2/n]decouple quantization implementation from vLLM dependency (#8112) · 5aa1ebd2
  Peng Zhang authored Aug 14, 2025
```
Co-authored-by: walker-ai <yiyun.wyt@antgroup.com>
Co-authored-by: leoneo <1320612015@qq.com>
```
  5aa1ebd2
12 Aug, 2025 1 commit
- [Feature] Support custom set kv buffer kernel (#8884) · 86a0be65
  DarkSharpness authored Aug 12, 2025
  
  86a0be65
10 Aug, 2025 1 commit
- Reorganize CI and test files (#9027) · 2c7f01bc
  Lianmin Zheng authored Aug 10, 2025
  
  2c7f01bc
05 Aug, 2025 1 commit
- fix: update cmake (#8817) · 8e8545ca
  Yineng Zhang authored Aug 05, 2025
  
  8e8545ca
04 Aug, 2025 1 commit
- Integrate triton_kernels in sgl-kernel (#8762) · fc8c8e50
  Qiaolin Yu authored Aug 04, 2025
  
  fc8c8e50
27 Jul, 2025 1 commit
- Update Cutlass in sgl-kernel to v4.1 (#8392) · 91e3d154
  Baizhou Zhang authored Jul 27, 2025
  
  91e3d154
23 Jul, 2025 1 commit
- fix: workaround for deepgemm warmup issue (#8302) · 4c605235
  Yineng Zhang authored Jul 23, 2025
  
  4c605235
20 Jul, 2025 1 commit
- Add bf16 output option for dsv3_router_gemm kernel (#7999) · 282eb59f
  Baizhou Zhang authored Jul 19, 2025
  
  282eb59f
14 Jul, 2025 1 commit
- [Feature] CUDA Green Context Support (#7649) · 1ebec1a8
  ykcombat authored Jul 15, 2025
  
  1ebec1a8
05 Jul, 2025 1 commit

[1/n]: add cutlass W4A8 moe kernel for hopper architecture (#7772) · da3890e8

SijiaYang authored Jul 05, 2025


Signed-off-by: yangsijia.614 <yangsijia.614@bytedance.com>
Co-authored-by: yicwang <yichen.wang@bytedance.com>

da3890e8

02 Jul, 2025 1 commit

[1/n] apply wna16marlin kernel in moe weight only quantization (#7683) · 8e03b641

AniZpZ authored Jul 02, 2025


Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: 弋云 <yiyun.wyt@antgroup.com>
Co-authored-by: walker-ai <2398833647@qq.com>

8e03b641

30 Jun, 2025 1 commit
- Add dsv3 router gemm kernel (#7627) · 7248272c
  Baizhou Zhang authored Jun 29, 2025
  
  7248272c
29 Jun, 2025 1 commit
- Add dsv3 fused a gemm to sgl-kernel (#7630) · 04b35190
  Ke Bao authored Jun 29, 2025
  
  04b35190