Commits · 4d98e486499831f2b057b275dc9c2694b31d5e23 · change / sglang

17 Aug, 2025 1 commit
- Revert "[Misc] feat: Deepgemm update for sgl-kernel (#8790)" to fix kernel CI (#9260) · 4d98e486
  Liangsheng Yin authored Aug 17, 2025
  
  4d98e486
15 Aug, 2025 4 commits
- Optional extension for green context (#9231) · 0c8594e6
  Liangsheng Yin authored Aug 15, 2025
  
  0c8594e6
- [Misc] feat: Deepgemm update for sgl-kernel (#8790) · a3d99d6d
  PGFLMG authored Aug 15, 2025
  
  a3d99d6d
- feat: remove sm75 (#9207) · 9d54c6e6
  Yineng Zhang authored Aug 14, 2025
  
  9d54c6e6
- use fast math for per_token_group_quant_8bit. (#9177) · 1f9d65f5
  strgrb authored Aug 15, 2025
```
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
```
  1f9d65f5
14 Aug, 2025 1 commit
- [2/n]decouple quantization implementation from vLLM dependency (#8112) · 5aa1ebd2
  Peng Zhang authored Aug 14, 2025
```
Co-authored-by: walker-ai <yiyun.wyt@antgroup.com>
Co-authored-by: leoneo <1320612015@qq.com>
```
  5aa1ebd2
12 Aug, 2025 1 commit
- [Feature] Support custom set kv buffer kernel (#8884) · 86a0be65
  DarkSharpness authored Aug 12, 2025
  
  86a0be65
10 Aug, 2025 1 commit
- Reorganize CI and test files (#9027) · 2c7f01bc
  Lianmin Zheng authored Aug 10, 2025
  
  2c7f01bc
05 Aug, 2025 1 commit
- fix: update cmake (#8817) · 8e8545ca
  Yineng Zhang authored Aug 05, 2025
  
  8e8545ca
04 Aug, 2025 1 commit
- Integrate triton_kernels in sgl-kernel (#8762) · fc8c8e50
  Qiaolin Yu authored Aug 04, 2025
  
  fc8c8e50
27 Jul, 2025 1 commit
- Update Cutlass in sgl-kernel to v4.1 (#8392) · 91e3d154
  Baizhou Zhang authored Jul 27, 2025
  
  91e3d154
23 Jul, 2025 1 commit
- fix: workaround for deepgemm warmup issue (#8302) · 4c605235
  Yineng Zhang authored Jul 23, 2025
  
  4c605235
20 Jul, 2025 1 commit
- Add bf16 output option for dsv3_router_gemm kernel (#7999) · 282eb59f
  Baizhou Zhang authored Jul 19, 2025
  
  282eb59f
14 Jul, 2025 1 commit
- [Feature] CUDA Green Context Support (#7649) · 1ebec1a8
  ykcombat authored Jul 15, 2025
  
  1ebec1a8
05 Jul, 2025 1 commit

[1/n]: add cutlass W4A8 moe kernel for hopper architecture (#7772) · da3890e8

SijiaYang authored Jul 05, 2025


Signed-off-by: yangsijia.614 <yangsijia.614@bytedance.com>
Co-authored-by: yicwang <yichen.wang@bytedance.com>

da3890e8

02 Jul, 2025 1 commit

[1/n] apply wna16marlin kernel in moe weight only quantization (#7683) · 8e03b641

AniZpZ authored Jul 02, 2025


Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: 弋云 <yiyun.wyt@antgroup.com>
Co-authored-by: walker-ai <2398833647@qq.com>

8e03b641

30 Jun, 2025 1 commit
- Add dsv3 router gemm kernel (#7627) · 7248272c
  Baizhou Zhang authored Jun 29, 2025
  
  7248272c
29 Jun, 2025 1 commit
- Add dsv3 fused a gemm to sgl-kernel (#7630) · 04b35190
  Ke Bao authored Jun 29, 2025
  
  04b35190
26 Jun, 2025 1 commit
- [CMake] Fix sgl-kernel CMakeLists for Blackwell (#7543) · 16d76b9f
  Ruihang Lai authored Jun 25, 2025
  
  16d76b9f
23 Jun, 2025 2 commits
- kvcache io kernels and test case (#7382) · 34c3f9b2
  Zhiqiang Xie authored Jun 23, 2025
  
  34c3f9b2
- Fix a bug in BatchTokenIDOut & Misc style and dependency updates (#7457) · 55e03b10
  Lianmin Zheng authored Jun 23, 2025
  
  55e03b10
12 Jun, 2025 2 commits
- feat: update blackwell setup (#7119) · 7046e0fa
  Yineng Zhang authored Jun 12, 2025
  
  7046e0fa
- [sgl-kernel] Add cuda kernel for moe_ep_silu_and_mul (#6919) · 84727a51
  Yuan Luo authored Jun 12, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  84727a51
07 Jun, 2025 1 commit
- [sgl-kernel] update deepgemm (#6942) · 22fe7878
  JieXin Liang authored Jun 07, 2025
  
  22fe7878
05 Jun, 2025 1 commit
- support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277) · 8e3797be
  zyksir authored Jun 05, 2025
  
  8e3797be
02 Jun, 2025 2 commits
- [1/2] Add Kernel support for Cutlass based Fused FP4 MoE (#6093) · eb38c7d1
  Pavani Majety authored Jun 02, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  eb38c7d1
- [EP] Add cuda kernel for moe_ep_pre_reorder (#6699) · 55444ed6
  Yuan Luo authored Jun 02, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  55444ed6
27 May, 2025 1 commit
- Disable compiling arch below sm_90 in aarch64 by default (#6380) · 0b9557fc
  Qiaolin Yu authored May 27, 2025
  
  0b9557fc
22 May, 2025 1 commit

[1/2] Support Qserve (#6457) · 4d643f6c

HandH1998 authored May 22, 2025


Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>

4d643f6c

16 May, 2025 2 commits
- [2/2] Add python wrapper for CUTLASS FP8 Blockscale MoE Kernel. (#5694) · 6fc93575
  Elfie Guo authored May 16, 2025
  
  6fc93575
- Upgrade CUTLASS 4.0 (#6336) · c23a7072
  Elfie Guo authored May 15, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  c23a7072
11 May, 2025 2 commits
- chore: upgrade deepgemm (#6073) · 213e8c7d
  Yineng Zhang authored May 11, 2025
  
  213e8c7d
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
06 May, 2025 1 commit
- chore: upgrade cutlass 3.9.2 (#6004) · 6f566147
  Yineng Zhang authored May 06, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  6f566147
01 May, 2025 1 commit
- add Thor & Spark (#5915) · 9f21e754
  Johnny authored May 01, 2025
  
  9f21e754
30 Apr, 2025 2 commits
- [Feat] Scale up fa3 kernel to sm8x arch (#5912) · 08acdb5c
  PGFLMG authored May 01, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  08acdb5c
- Add sm_120 for blackwell (#5903) · 403b855a
  zhjunqin authored Apr 30, 2025
  
  403b855a
29 Apr, 2025 1 commit
- cutlass 3.9 supported to improve fp8_blockwise_gemm (#5820) · 5bb0accb
  Xiaoyu Zhang authored Apr 29, 2025
  
  5bb0accb
28 Apr, 2025 1 commit
- [Feat] QWen-1M context support[1/2]: Update block sparse attention backend utils kernel (#5847) · ee71ed8a
  PGFLMG authored Apr 29, 2025
```
Co-authored-by: sighingnow <sighingnow@gmail.com>
```
  ee71ed8a
23 Apr, 2025 1 commit
- fix sgl-kernel unit tests (#5666) · 15fabcc0
  Yineng Zhang authored Apr 23, 2025
  
  15fabcc0