Commits · e7bc600304e98fa54184f4d7331b4e68016890b4 · change / sglang

18 Sep, 2025 1 commit
- [Feature] Speculative decoding support lookahead (#9873) · e7bc6003
  Zhihao Zhang authored Sep 19, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  e7bc6003
15 Sep, 2025 1 commit
- [1/2] Speed up trtllm_mla attention backend (>10% e2e) (#10473) · 3b25dc12
  fzyzcjy authored Sep 16, 2025
  
  3b25dc12
13 Sep, 2025 1 commit
- Fix the style of sgl kernel (#10398) · c9ec4cae
  Lianmin Zheng authored Sep 12, 2025
  
  c9ec4cae
11 Sep, 2025 1 commit
- Revert "[1/2] Optimizations and refactors about quant kernel (#9534)" (#10292) · 6d55f60e
  Yineng Zhang authored Sep 10, 2025
  
  6d55f60e
10 Sep, 2025 1 commit
- Page first direct IO kernel (#10060) · 5be8c2f7
  huangtingwei authored Sep 10, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  5be8c2f7
09 Sep, 2025 1 commit
- Add mamba kernel (#10234) · 8cbe1538
  Yi Zhang authored Sep 10, 2025
  
  8cbe1538
08 Sep, 2025 1 commit
- [1/2] Speed up prefill mla attention (#10156) · 0096798e
  fzyzcjy authored Sep 09, 2025
  
  0096798e
06 Sep, 2025 1 commit
- [chore] Remove unused ep_moe cuda kernels (#9956) · 5f1eb204
  hlu1 authored Sep 06, 2025
  
  5f1eb204
05 Sep, 2025 2 commits
- Support copying tensor from cpu to gpu without using copy engines (#10007) · bd7f8821
  fzyzcjy authored Sep 05, 2025
  
  bd7f8821
- [1/2] Optimizations and refactors about quant kernel (#9534) · 339f8eef
  fzyzcjy authored Sep 05, 2025
  
  339f8eef
30 Aug, 2025 1 commit
- [NVIDIA] [2/N] Optimize `silu_and_mul_scaled_fp4_grouped_quant` perf (#9556) · 5c34b4f1
  Kaixi Hou authored Aug 29, 2025
  
  5c34b4f1
28 Aug, 2025 1 commit
- [AMD] Support Hierarchical Caching on AMD GPUs (#8236) · 711390a9
  Hubert Lu authored Aug 28, 2025
  
  711390a9
22 Aug, 2025 2 commits
- [NVIDA] [1/N] Nvfp4 Masked Gemm: Add quant op for the flashinfer grouped gemm (#9200) · e5638573
  Kaixi Hou authored Aug 22, 2025
  
  e5638573
- [AMD] Remove the deprecated C10_WARP_SIZE (#9356) · 704ced1b
  Hubert Lu authored Aug 21, 2025
  
  704ced1b
20 Aug, 2025 1 commit
- Add PDL support for quant kernel and rope kernel (#9106) · 42c87045
  fzyzcjy authored Aug 20, 2025
  
  42c87045
18 Aug, 2025 2 commits
- [AMD] Reorganize hip-related header files in sgl-kernel (#9320) · c6c379ab
  Hubert Lu authored Aug 18, 2025
  
  c6c379ab
- Minor style fixes for sgl-kernel (#9289) · c480a3f6
  Lianmin Zheng authored Aug 18, 2025
  
  c480a3f6
17 Aug, 2025 1 commit
- [fix]: fix cutlass moe ut and and Opt H20 cutlass groupGemm performance (#9272) · 0fc54b97
  kousakawang authored Aug 18, 2025
```
Co-authored-by: wanghanpei <wanghanpei@bytedance.com>
```
  0fc54b97
14 Aug, 2025 2 commits
- [sgl-kernel] Support FlashInfer top_k_top_p_sampling_from_logits (#9060) · 53dcc750
  Yuan Luo authored Aug 15, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  53dcc750
- [2/n]decouple quantization implementation from vLLM dependency (#8112) · 5aa1ebd2
  Peng Zhang authored Aug 14, 2025
```
Co-authored-by: walker-ai <yiyun.wyt@antgroup.com>
Co-authored-by: leoneo <1320612015@qq.com>
```
  5aa1ebd2
13 Aug, 2025 2 commits
- Update fa3 interface and add unit test (#9150) · 94f44b88
  Ke Bao authored Aug 13, 2025
  
  94f44b88
- [1/2][resubmit again] sgl-kernel: Fuse routed scaling factor into moe_fused_gate (#9088) · 13c48dcf
  Trevor Morris authored Aug 12, 2025
  
  13c48dcf
12 Aug, 2025 2 commits
- [Feature] Support custom set kv buffer kernel (#8884) · 86a0be65
  DarkSharpness authored Aug 12, 2025
  
  86a0be65
- Fuse writing KV buffer into rope kernel (part 1: sgl-kernel) (#9077) · 9aea2555
  fzyzcjy authored Aug 12, 2025
  
  9aea2555
11 Aug, 2025 1 commit
- Revert "[1/2][resubmit] sgl-kernel: Fuse routed scaling factor into m… (#9035) · dd949ace
  Yineng Zhang authored Aug 10, 2025
  
  dd949ace
10 Aug, 2025 1 commit
- fix page first per layer pf2lf kernel (#8915) · 86497d99
  huangtingwei authored Aug 10, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  86497d99
09 Aug, 2025 1 commit
- [1/2][resubmit] sgl-kernel: Fuse routed scaling factor into moe_fused_gate (select_experts) (#8770) · 591c232f
  Trevor Morris authored Aug 08, 2025
  
  591c232f
02 Aug, 2025 2 commits
- Revert "[1/2] sgl-kernel: Fuse routed scaling factor into select_experts" (#8706) · f9f0138f
  Liangsheng Yin authored Aug 02, 2025
  
  f9f0138f
- [1/2] sgl-kernel: Fuse routed scaling factor into select_experts (#8364) · f642524f
  Trevor Morris authored Aug 01, 2025
  
  f642524f
31 Jul, 2025 1 commit

update sgl-kernel for EP: kernel part (#8514) · a5f5ab40

Cheng Wan authored Jul 30, 2025


Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>

a5f5ab40

25 Jul, 2025 2 commits

[AMD] Add silu_and_mul, gelu_and_mul, gelu_tanh_and_mul, and gelu_quick... · af4b9bae

Hubert Lu authored Jul 24, 2025


[AMD] Add silu_and_mul, gelu_and_mul, gelu_tanh_and_mul, and gelu_quick kernels for AMD GPUs (#7135)
Co-authored-by: yiakwy-xpu-ml-framework-team <961186938@qq.com>
Co-authored-by: HAI <hixiao@gmail.com>

af4b9bae

[Feature] Integrate quick allreduce and select the best allreduce implementation (#6619) · 28d4d472
li haoyang authored Jul 25, 2025
```
Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>
```
28d4d472

23 Jul, 2025 1 commit
- Hicache IO kernel refactoring (#8264) · b4326330
  Zhiqiang Xie authored Jul 23, 2025
  
  b4326330
14 Jul, 2025 1 commit
- [Feature] CUDA Green Context Support (#7649) · 1ebec1a8
  ykcombat authored Jul 15, 2025
  
  1ebec1a8
07 Jul, 2025 1 commit
- Optimize moe align block size kernel (#7794) · a3398d84
  Ke Bao authored Jul 07, 2025
  
  a3398d84
05 Jul, 2025 2 commits
- Add treemask mode to build_eagle_tree & release sgl-kernel 0.2.3 (#7756) · 5589b750
  Lianmin Zheng authored Jul 05, 2025
```
Co-authored-by: Pranjal Shankhdhar <pranjal.ssh@gmail.com>
```
  5589b750
- [1/n]: add cutlass W4A8 moe kernel for hopper architecture (#7772) · da3890e8
  SijiaYang authored Jul 05, 2025
```
Signed-off-by: yangsijia.614 <yangsijia.614@bytedance.com>
Co-authored-by: yicwang <yichen.wang@bytedance.com>
```
  da3890e8
03 Jul, 2025 1 commit
- [optimize] fuse renormalize into moe_topk_softmax (#7744) · 2998c4bd
  Yi Zhang authored Jul 04, 2025
```
Co-authored-by: ispobock <ispobaoke@gmail.com>
```
  2998c4bd
02 Jul, 2025 1 commit

[1/n] apply wna16marlin kernel in moe weight only quantization (#7683) · 8e03b641

AniZpZ authored Jul 02, 2025


Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: 弋云 <yiyun.wyt@antgroup.com>
Co-authored-by: walker-ai <2398833647@qq.com>

8e03b641

30 Jun, 2025 1 commit
- Add dsv3 router gemm kernel (#7627) · 7248272c
  Baizhou Zhang authored Jun 29, 2025
  
  7248272c