Commits · cbb5fc2edc3165a8745edf90e674c0e4ad6336eb · change / sglang

16 Oct, 2025 1 commit
- [sgl-kernel] support hadamard (#11663) · 3289da5b
  Fan Yin authored Oct 16, 2025
  
  3289da5b
14 Oct, 2025 1 commit
- Revert "[NVIDIA] BUMP FA3 (#11444)" (#11582) · f792e3c5
  Yineng Zhang authored Oct 13, 2025
  
  f792e3c5
13 Oct, 2025 2 commits

Johnny authored Oct 13, 2025


Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>

b8c430f1

[sgl-kernel][1/N]Support Expert Specialization Grouped GEMM (#11432) · 9a30914e

Qi Yuhang authored Oct 13, 2025


Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: PGFLMG <1106310035@qq.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>

9a30914e

11 Oct, 2025 2 commits
- [7/n] decouple quantization impl from vllm dependency - gguf kernel (#11019) · 8fdcd98e
  PGFLMG authored Oct 12, 2025
  
  8fdcd98e
- Reland [1/2] Optimizations and refactors about quant kernel (#10312) · 21337b22
  fzyzcjy authored Oct 11, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  21337b22
08 Oct, 2025 1 commit
- fix: fix revision for sgl-flash-attn in sgl-kernel (#11327) · a3c2ea44
  Mick authored Oct 09, 2025
  
  a3c2ea44
05 Oct, 2025 2 commits
- Update DeepGEMM repository tag to specific commit (#11229) · 148d8d48
  Lianmin Zheng authored Oct 05, 2025
  
  148d8d48
- [Feature] Add a fast-topk to sgl-kernel for DeepSeek v3.2 (#11194) · e0b2d3ee
  DarkSharpness authored Oct 06, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  e0b2d3ee
29 Sep, 2025 2 commits
- [speculative decoding] rename lookahead to ngram (#11010) · 24f7cb1e
  Zhihao Zhang authored Sep 29, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
```
  24f7cb1e
- Unify SGL Kernel Releases (#10701) · 0c917410
  Kangyan-Zhou authored Sep 28, 2025
  
  0c917410
19 Sep, 2025 1 commit

[sgl-kernel] Support moe_sum_reduce cuda kernel (#10321) · 616a3e20

Yuan Luo authored Sep 19, 2025


Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>

616a3e20

18 Sep, 2025 1 commit
- [Feature] Speculative decoding support lookahead (#9873) · e7bc6003
  Zhihao Zhang authored Sep 19, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  e7bc6003
16 Sep, 2025 1 commit
- Update CUTLASS. Refine KernelSchedule for fp8 (grouped) gemm. (#10491) · 9b876889
  Qi Yuhang authored Sep 16, 2025
  
  9b876889
14 Sep, 2025 1 commit
- fix: use latest flashinfer (#10428) · 55025b92
  Yineng Zhang authored Sep 14, 2025
  
  55025b92
13 Sep, 2025 1 commit
- Fix the style of sgl kernel (#10398) · c9ec4cae
  Lianmin Zheng authored Sep 12, 2025
  
  c9ec4cae
11 Sep, 2025 1 commit
- Revert "Fix flashinfer version in sgl-kernel (#10135)" (#10310) · de15d140
  Yineng Zhang authored Sep 11, 2025
  
  de15d140
09 Sep, 2025 2 commits
- Add mamba kernel (#10234) · 8cbe1538
  Yi Zhang authored Sep 10, 2025
  
  8cbe1538
- feat: support fa cute in sgl-kernel (#10205) · 94fb4e9e
  Yineng Zhang authored Sep 09, 2025
```
Co-authored-by: cicirori <32845984+cicirori@users.noreply.github.com>
```
  94fb4e9e
08 Sep, 2025 2 commits
- [1/2] Speed up prefill mla attention (#10156) · 0096798e
  fzyzcjy authored Sep 09, 2025
  
  0096798e
- move compile threads to an option to avoid OOM on low memory host (#10123) · 6049ca20
  Rain Jiang authored Sep 07, 2025
  
  6049ca20
07 Sep, 2025 1 commit
- Fix flashinfer version in sgl-kernel (#10135) · 76a2c86b
  Lianmin Zheng authored Sep 07, 2025
  
  76a2c86b
06 Sep, 2025 2 commits
- [chore] Remove unused ep_moe cuda kernels (#9956) · 5f1eb204
  hlu1 authored Sep 06, 2025
  
  5f1eb204
- Remove non-accelerated targets(100 and up) from cmake (#10041) · 039cef76
  hlu1 authored Sep 06, 2025
```
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
```
  039cef76
05 Sep, 2025 1 commit
- Support copying tensor from cpu to gpu without using copy engines (#10007) · bd7f8821
  fzyzcjy authored Sep 05, 2025
  
  bd7f8821
03 Sep, 2025 1 commit
- Remove annoying warnings in sgl kernel build (#9905) · d631290e
  Lianmin Zheng authored Sep 02, 2025
  
  d631290e
30 Aug, 2025 1 commit
- [sgl-kernel] fix: fix missing FetchContent_Populate for fmt (#9826) · 7fe89f7c
  PGFLMG authored Aug 31, 2025
  
  7fe89f7c
28 Aug, 2025 1 commit
- Support compile sgl-kernel on cuda 13.0 (#9721) · 6b39f9cf
  Rain Jiang authored Aug 28, 2025
  
  6b39f9cf
27 Aug, 2025 2 commits
- [sgl-kernel] misc: update deepgemm version for sgl-kernel (#9340) · aa3eba8e
  PGFLMG authored Aug 28, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
```
  aa3eba8e
- support cuda 13.0 and trtllm kernel by Aug 25 2025 (#9495) · 79e6a8a6
  Rain Jiang authored Aug 26, 2025
  
  79e6a8a6
25 Aug, 2025 1 commit
- Update CUTLASS 4.2 & Enable K-Major Scale Factor for SM90 FP8 Blockwise Group GEMM (#9559) · fda47926
  Qi Yuhang authored Aug 25, 2025
  
  fda47926
19 Aug, 2025 1 commit
- Add `CMakeLists.txt` binary_dir (#7019) · 720cd308
  EduardDurech authored Aug 19, 2025
  
  720cd308
18 Aug, 2025 1 commit
- Minor style fixes for sgl-kernel (#9289) · c480a3f6
  Lianmin Zheng authored Aug 18, 2025
  
  c480a3f6
17 Aug, 2025 1 commit
- Revert "[Misc] feat: Deepgemm update for sgl-kernel (#8790)" to fix kernel CI (#9260) · 4d98e486
  Liangsheng Yin authored Aug 17, 2025
  
  4d98e486
15 Aug, 2025 4 commits
- Optional extension for green context (#9231) · 0c8594e6
  Liangsheng Yin authored Aug 15, 2025
  
  0c8594e6
- [Misc] feat: Deepgemm update for sgl-kernel (#8790) · a3d99d6d
  PGFLMG authored Aug 15, 2025
  
  a3d99d6d
- feat: remove sm75 (#9207) · 9d54c6e6
  Yineng Zhang authored Aug 14, 2025
  
  9d54c6e6
- use fast math for per_token_group_quant_8bit. (#9177) · 1f9d65f5
  strgrb authored Aug 15, 2025
```
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
```
  1f9d65f5
14 Aug, 2025 1 commit
- [2/n]decouple quantization implementation from vLLM dependency (#8112) · 5aa1ebd2
  Peng Zhang authored Aug 14, 2025
```
Co-authored-by: walker-ai <yiyun.wyt@antgroup.com>
Co-authored-by: leoneo <1320612015@qq.com>
```
  5aa1ebd2
12 Aug, 2025 1 commit
- [Feature] Support custom set kv buffer kernel (#8884) · 86a0be65
  DarkSharpness authored Aug 12, 2025
  
  86a0be65