Commits · da3890e82a97e9b1f970133c0fef6341a8bbf791 · change / sglang

05 Jul, 2025 1 commit

[1/n]: add cutlass W4A8 moe kernel for hopper architecture (#7772) · da3890e8

SijiaYang authored Jul 05, 2025


Signed-off-by: yangsijia.614 <yangsijia.614@bytedance.com>
Co-authored-by: yicwang <yichen.wang@bytedance.com>

da3890e8

02 Jul, 2025 1 commit

[1/n] apply wna16marlin kernel in moe weight only quantization (#7683) · 8e03b641

AniZpZ authored Jul 02, 2025


Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: 弋云 <yiyun.wyt@antgroup.com>
Co-authored-by: walker-ai <2398833647@qq.com>

8e03b641

30 Jun, 2025 1 commit
- Add dsv3 router gemm kernel (#7627) · 7248272c
  Baizhou Zhang authored Jun 29, 2025
  
  7248272c
29 Jun, 2025 1 commit
- Add dsv3 fused a gemm to sgl-kernel (#7630) · 04b35190
  Ke Bao authored Jun 29, 2025
  
  04b35190
26 Jun, 2025 1 commit
- [CMake] Fix sgl-kernel CMakeLists for Blackwell (#7543) · 16d76b9f
  Ruihang Lai authored Jun 25, 2025
  
  16d76b9f
23 Jun, 2025 2 commits
- kvcache io kernels and test case (#7382) · 34c3f9b2
  Zhiqiang Xie authored Jun 23, 2025
  
  34c3f9b2
- Fix a bug in BatchTokenIDOut & Misc style and dependency updates (#7457) · 55e03b10
  Lianmin Zheng authored Jun 23, 2025
  
  55e03b10
12 Jun, 2025 2 commits
- feat: update blackwell setup (#7119) · 7046e0fa
  Yineng Zhang authored Jun 12, 2025
  
  7046e0fa
- [sgl-kernel] Add cuda kernel for moe_ep_silu_and_mul (#6919) · 84727a51
  Yuan Luo authored Jun 12, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  84727a51
07 Jun, 2025 1 commit
- [sgl-kernel] update deepgemm (#6942) · 22fe7878
  JieXin Liang authored Jun 07, 2025
  
  22fe7878
05 Jun, 2025 1 commit
- support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277) · 8e3797be
  zyksir authored Jun 05, 2025
  
  8e3797be
02 Jun, 2025 2 commits
- [1/2] Add Kernel support for Cutlass based Fused FP4 MoE (#6093) · eb38c7d1
  Pavani Majety authored Jun 02, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  eb38c7d1
- [EP] Add cuda kernel for moe_ep_pre_reorder (#6699) · 55444ed6
  Yuan Luo authored Jun 02, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  55444ed6
27 May, 2025 1 commit
- Disable compiling arch below sm_90 in aarch64 by default (#6380) · 0b9557fc
  Qiaolin Yu authored May 27, 2025
  
  0b9557fc
22 May, 2025 1 commit

[1/2] Support Qserve (#6457) · 4d643f6c

HandH1998 authored May 22, 2025


Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>

4d643f6c

16 May, 2025 2 commits
- [2/2] Add python wrapper for CUTLASS FP8 Blockscale MoE Kernel. (#5694) · 6fc93575
  Elfie Guo authored May 16, 2025
  
  6fc93575
- Upgrade CUTLASS 4.0 (#6336) · c23a7072
  Elfie Guo authored May 15, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  c23a7072
11 May, 2025 2 commits
- chore: upgrade deepgemm (#6073) · 213e8c7d
  Yineng Zhang authored May 11, 2025
  
  213e8c7d
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
06 May, 2025 1 commit
- chore: upgrade cutlass 3.9.2 (#6004) · 6f566147
  Yineng Zhang authored May 06, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  6f566147
01 May, 2025 1 commit
- add Thor & Spark (#5915) · 9f21e754
  Johnny authored May 01, 2025
  
  9f21e754
30 Apr, 2025 2 commits
- [Feat] Scale up fa3 kernel to sm8x arch (#5912) · 08acdb5c
  PGFLMG authored May 01, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  08acdb5c
- Add sm_120 for blackwell (#5903) · 403b855a
  zhjunqin authored Apr 30, 2025
  
  403b855a
29 Apr, 2025 1 commit
- cutlass 3.9 supported to improve fp8_blockwise_gemm (#5820) · 5bb0accb
  Xiaoyu Zhang authored Apr 29, 2025
  
  5bb0accb
28 Apr, 2025 1 commit
- [Feat] QWen-1M context support[1/2]: Update block sparse attention backend utils kernel (#5847) · ee71ed8a
  PGFLMG authored Apr 29, 2025
```
Co-authored-by: sighingnow <sighingnow@gmail.com>
```
  ee71ed8a
23 Apr, 2025 2 commits
- fix sgl-kernel unit tests (#5666) · 15fabcc0
  Yineng Zhang authored Apr 23, 2025
  
  15fabcc0
- [1/2] Add FP8 Blockscale MoE CUTLASS kernel for Blackwell (#5281) · e62c4955
  Elfie Guo authored Apr 22, 2025
  
  e62c4955
17 Apr, 2025 1 commit
- [Feat] Update sgl-kernel flashinfer to latest main version (#5500) · c08a717c
  PGFLMG authored Apr 18, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  c08a717c
16 Apr, 2025 1 commit
- Update cutlass dependency. (#5447) · 85ec0440
  Elfie Guo authored Apr 15, 2025
  
  85ec0440
15 Apr, 2025 4 commits
- [minor] cleanup cmakelists.txt (#5420) · 838fa0f2
  Lianmin Zheng authored Apr 15, 2025
  
  838fa0f2
- kernel: support slightly faster merge_state_v2 cuda kernel (#5381) · 388e15c0
  DefTruth authored Apr 15, 2025
  
  388e15c0
- chore: upgrade DeepGEMM (#5395) · 6c41fcf0
  Yineng Zhang authored Apr 14, 2025
  
  6c41fcf0
- minor clean up of sgl-kernel/CMakeLists.txt (#5393) · dae79444
  Lianmin Zheng authored Apr 14, 2025
  
  dae79444
13 Apr, 2025 1 commit
- feat: adapt merge_state (#5337) · b62e7e99
  Yineng Zhang authored Apr 12, 2025
  
  b62e7e99
12 Apr, 2025 2 commits
- [Feat] Add sparse attn to sgl-kernel (#5327) · 4879e50c
  PGFLMG authored Apr 13, 2025
  
  4879e50c
- Blackwell Cutlass MLA kernel (#5142) · f65b8d5c
  Trevor Morris authored Apr 11, 2025
  
  f65b8d5c
11 Apr, 2025 2 commits
- fix: remove cublas_grouped_gemm (#5307) · 136b8e6a
  Yineng Zhang authored Apr 11, 2025
  
  136b8e6a
- fix: enable fp4 compilation on cu128 (#5286) · 7074e9ca
  Yineng Zhang authored Apr 11, 2025
  
  7074e9ca
05 Apr, 2025 1 commit
- sgl-kernel transfer custom allreduce from trt kernel to vllm kernel (#5079) · bcbbf519
  Yi Zhang authored Apr 06, 2025
  
  bcbbf519
03 Apr, 2025 1 commit
- [Fix] fix fa3 build at cu118 (#5036) · b8b6008f
  yinfan98 authored Apr 04, 2025
  
  b8b6008f