Commits · ff00895c46a4549f6c4279b1f8de24c05f1fa7ef · change / sglang

03 Jun, 2025 1 commit
- Add CPU optimized kernels for topk and rope fusions (#6456) · ff00895c
  jianan-gu authored Jun 03, 2025
  
  ff00895c
02 Jun, 2025 2 commits
- [1/2] Add Kernel support for Cutlass based Fused FP4 MoE (#6093) · eb38c7d1
  Pavani Majety authored Jun 02, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  eb38c7d1
- [EP] Add cuda kernel for moe_ep_pre_reorder (#6699) · 55444ed6
  Yuan Luo authored Jun 02, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  55444ed6
23 May, 2025 2 commits
- Add fp8 fused_experts kernel for CPU in sgl-kernel and add UT (#6404) · 3ded6235
  Chunyuan WU authored May 23, 2025
  
  3ded6235
- Add fp8 qkv_proj_with_rope kernel for CPU in sgl-kernel and add UT (#6493) · 4ba1eea8
  blzheng authored May 23, 2025
  
  4ba1eea8
22 May, 2025 1 commit

HandH1998 authored May 22, 2025


Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>

4d643f6c

21 May, 2025 1 commit
- [CPU] Fix build issue (#6419) · cfe48c59
  blzheng authored May 22, 2025
  
  cfe48c59
20 May, 2025 1 commit
- Update extend/decode attention kernel for CPU in sgl-kernel and add UTs (#6405) · 32cc66ef
  YanbingJiang authored May 20, 2025
```
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  32cc66ef
18 May, 2025 1 commit
- Add fp8 shared_expert kernel for CPU in sgl-kernel and add UT (#6339) · 5dd62c3a
  Chunyuan WU authored May 19, 2025
```
Co-authored-by: Jiang, Yanbing <yanbing.jiang@intel.com>
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  5dd62c3a
16 May, 2025 2 commits
- [2/2] Add python wrapper for CUTLASS FP8 Blockscale MoE Kernel. (#5694) · 6fc93575
  Elfie Guo authored May 16, 2025
  
  6fc93575
- Upgrade CUTLASS 4.0 (#6336) · c23a7072
  Elfie Guo authored May 15, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  c23a7072
15 May, 2025 1 commit
- Add fp8 gemm kernel for CPU in sgl-kernel and add gemm UT (#6216) · fb4959b2
  Chunyuan WU authored May 16, 2025
```
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  fb4959b2
13 May, 2025 1 commit
- [CPU] Add CMakeLists.txt for sgl-kernel (#6115) · 0f75b907
  blzheng authored May 14, 2025
  
  0f75b907
12 May, 2025 2 commits
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
11 May, 2025 1 commit
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
09 May, 2025 1 commit
- Cutlass MLA: Disable split kv due to https://github.com/NVIDIA/cutlass/issues/2274 (#6101) · 0ab3f437
  Trevor Morris authored May 08, 2025
  
  0ab3f437
08 May, 2025 1 commit
- [sgl-kernel] fix: fix cu118 compile error (#6123) · f6f96b05
  PGFLMG authored May 09, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  f6f96b05
07 May, 2025 1 commit
- fix custom_allreduce namespace (#6039) · d25398cb
  Xiaoyu Zhang authored May 07, 2025
  
  d25398cb
06 May, 2025 1 commit
- chore: upgrade cutlass 3.9.2 (#6004) · 6f566147
  Yineng Zhang authored May 06, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  6f566147
29 Apr, 2025 1 commit
- cutlass 3.9 supported to improve fp8_blockwise_gemm (#5820) · 5bb0accb
  Xiaoyu Zhang authored Apr 29, 2025
  
  5bb0accb
28 Apr, 2025 1 commit
- [Feat] QWen-1M context support[1/2]: Update block sparse attention backend utils kernel (#5847) · ee71ed8a
  PGFLMG authored Apr 29, 2025
```
Co-authored-by: sighingnow <sighingnow@gmail.com>
```
  ee71ed8a
23 Apr, 2025 3 commits
- fix: only compile ApplyTokenBitmaskInplace cu124+ (#5686) · ce4ecba4
  Yineng Zhang authored Apr 23, 2025
  
  ce4ecba4
- fix sgl-kernel unit tests (#5666) · 15fabcc0
  Yineng Zhang authored Apr 23, 2025
  
  15fabcc0
- [1/2] Add FP8 Blockscale MoE CUTLASS kernel for Blackwell (#5281) · e62c4955
  Elfie Guo authored Apr 22, 2025
  
  e62c4955
18 Apr, 2025 1 commit
- Sgl kernel fused_moe_gate support n_shared_experts (#5440) · 8e09b370
  Xiaoyu Zhang authored Apr 18, 2025
  
  8e09b370
17 Apr, 2025 1 commit
- [Feat] Update sgl-kernel flashinfer to latest main version (#5500) · c08a717c
  PGFLMG authored Apr 18, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  c08a717c
15 Apr, 2025 2 commits
- bugfix: fix merge_state_v2 cuda graph (#5419) · 12ef7e3b
  DefTruth authored Apr 16, 2025
  
  12ef7e3b
- kernel: support slightly faster merge_state_v2 cuda kernel (#5381) · 388e15c0
  DefTruth authored Apr 15, 2025
  
  388e15c0
13 Apr, 2025 1 commit
- feat: adapt merge_state (#5337) · b62e7e99
  Yineng Zhang authored Apr 12, 2025
  
  b62e7e99
12 Apr, 2025 4 commits
- fix: solve cu118 issue for cutlass mla (#5331) · 812e82f3
  Yineng Zhang authored Apr 12, 2025
  
  812e82f3
- [Feat] Add sparse attn to sgl-kernel (#5327) · 4879e50c
  PGFLMG authored Apr 13, 2025
  
  4879e50c
- update variable naming and comments for rocm (#5299) · 3c9740d2
  Zhaoyi Li authored Apr 12, 2025
  
  3c9740d2
- Blackwell Cutlass MLA kernel (#5142) · f65b8d5c
  Trevor Morris authored Apr 11, 2025
  
  f65b8d5c
11 Apr, 2025 1 commit
- fix: remove cublas_grouped_gemm (#5307) · 136b8e6a
  Yineng Zhang authored Apr 11, 2025
  
  136b8e6a
10 Apr, 2025 2 commits
- Fix deepseek-v3 with torch.compile in PyTorch 2.6. (#5213) · 76f44c2a
  Richard Zou authored Apr 10, 2025
  
  76f44c2a
- reduce moe_align_block_size_kernel small batch mode overhead (#5086) · f730362e
  Xiaoyu Zhang authored Apr 10, 2025
  
  f730362e
09 Apr, 2025 1 commit
- sgl-kernel use cutlass latest version for fp8 blockwise gemm (#5207) · ebf495f0
  Yi Zhang authored Apr 10, 2025
  
  ebf495f0
08 Apr, 2025 1 commit

Add optimized native kernels in sgl-kernel (#5150) · a73c4df4

Ma Mingfei authored Apr 09, 2025


Co-authored-by: Chunyuan WU <chunyuan.wu@intel.com>
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
Co-authored-by: blzheng <beilei.zheng@intel.com>

a73c4df4

05 Apr, 2025 1 commit
- sgl-kernel transfer custom allreduce from trt kernel to vllm kernel (#5079) · bcbbf519
  Yi Zhang authored Apr 06, 2025
  
  bcbbf519