Commits · 36cc3ffdc705df06d007786fdd979f2e1493a07a · change / sglang

03 Jul, 2025 2 commits
- [CPU] [sgl-kernel] set dispatch key of initialize to CatchAll (#7734) · 36cc3ffd
  Chunyuan WU authored Jul 03, 2025
  
  36cc3ffd
- Support non-contiguous query input for extend/decode attention (#7462) · b044400d
  YanbingJiang authored Jul 03, 2025
  
  b044400d
02 Jul, 2025 1 commit

[1/n] apply wna16marlin kernel in moe weight only quantization (#7683) · 8e03b641

AniZpZ authored Jul 02, 2025


Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: 弋云 <yiyun.wyt@antgroup.com>
Co-authored-by: walker-ai <2398833647@qq.com>

8e03b641

01 Jul, 2025 1 commit
- [CPU] remove process_group from inputs of shm_allreduce and shm_allgather (#7486) · 6005ecee
  Chunyuan WU authored Jul 01, 2025
  
  6005ecee
30 Jun, 2025 2 commits
- Add dsv3 router gemm kernel (#7627) · 7248272c
  Baizhou Zhang authored Jun 29, 2025
  
  7248272c
- [CPU] add c++ kernel to bind CPU cores and memory node (#7524) · c5131f7a
  Chunyuan WU authored Jun 30, 2025
  
  c5131f7a
29 Jun, 2025 1 commit
- Add dsv3 fused a gemm to sgl-kernel (#7630) · 04b35190
  Ke Bao authored Jun 29, 2025
  
  04b35190
25 Jun, 2025 2 commits
- [CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel... · 7eb47b0f
  Chunyuan WU authored Jun 25, 2025
```
[CPU] [BF16] Call fused_experts_cpu, weight_packed_linear and bmm_cpu kernel in DeepSeek model (#6641)
Co-authored-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  7eb47b0f
- Fuse sorted_token_ids padding to moe_align_block_size kernel (#7437) · 57ab7769
  Ke Bao authored Jun 25, 2025
  
  57ab7769
23 Jun, 2025 1 commit
- kvcache io kernels and test case (#7382) · 34c3f9b2
  Zhiqiang Xie authored Jun 23, 2025
  
  34c3f9b2
17 Jun, 2025 1 commit
- Fix AWQ Dequant and Weight Loading of deepseek v2 (#6842) · 3eb4a800
  AniZpZ authored Jun 18, 2025
  
  3eb4a800
16 Jun, 2025 1 commit
- Fix sampling for speculative decoding & simplify kernels (#7207) · cfceb83d
  Lianmin Zheng authored Jun 16, 2025
  
  cfceb83d
14 Jun, 2025 1 commit
- [fix] fix cutlass_mla_backend with cuda_graph and add sm_scale for sgl-kernel cutlass_mla (#7184) · ab1a4fa5
  JieXin Liang authored Jun 15, 2025
  
  ab1a4fa5
13 Jun, 2025 2 commits
- Support new DeepGEMM format in per token group quant (#7146) · 5c66c442
  fzyzcjy authored Jun 13, 2025
  
  5c66c442
- Remove 200us slow concat kernel (part 1: kernel) (#7145) · aa46ed34
  fzyzcjy authored Jun 13, 2025
  
  aa46ed34
12 Jun, 2025 1 commit
- [sgl-kernel] Add cuda kernel for moe_ep_silu_and_mul (#6919) · 84727a51
  Yuan Luo authored Jun 12, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  84727a51
10 Jun, 2025 2 commits
- Tiny fix cutlass_mla_get_workspace_size stub incorrect signature (#7057) · 19995dd7
  fzyzcjy authored Jun 11, 2025
  
  19995dd7
- CPU: map changes from developing branch in sgl-kernel (#6833) · fcde67b0
  YanbingJiang authored Jun 10, 2025
```
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  fcde67b0
09 Jun, 2025 1 commit
- [perf][sgl-kernel] extend cutlass_mla_decode to support num_head < 128 (#6929) · 18efb5e8
  JieXin Liang authored Jun 09, 2025
  
  18efb5e8
07 Jun, 2025 2 commits
- Add a CUDA kernel for fusing mapping and weighted sum for MoE. (#6916) · 3e56f557
  Elfie Guo authored Jun 07, 2025
```
Co-authored-by: Elfie Guo <elfiegxf@gmail.com>
```
  3e56f557
- reduce torch.zeros overhead in moe align block size kernel (#6369) · 8b5f83ed
  Xiaoyu Zhang authored Jun 07, 2025
  
  8b5f83ed
05 Jun, 2025 2 commits
- [EP] Add cuda kernel for moe_ep_post_reorder (#6837) · 43baba64
  Yuan Luo authored Jun 05, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  43baba64
- support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277) · 8e3797be
  zyksir authored Jun 05, 2025
  
  8e3797be
04 Jun, 2025 3 commits
- Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts... · 81964328
  Cheng Wan authored Jun 04, 2025
```
Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts fusion is not disabled (#6736)
```
  81964328
- fix ep_moe_reorder kernel bugs (#6858) · bd75690f
  Xiaoyu Zhang authored Jun 04, 2025
```
Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>
```
  bd75690f
- [Refactor] Rename `n_share_experts_fusion` as `num_fused_shared_experts` (#6735) · 8a548052
  Cheng Wan authored Jun 03, 2025
  
  8a548052
03 Jun, 2025 1 commit
- Add CPU optimized kernels for topk and rope fusions (#6456) · ff00895c
  jianan-gu authored Jun 03, 2025
  
  ff00895c
02 Jun, 2025 2 commits
- [1/2] Add Kernel support for Cutlass based Fused FP4 MoE (#6093) · eb38c7d1
  Pavani Majety authored Jun 02, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  eb38c7d1
- [EP] Add cuda kernel for moe_ep_pre_reorder (#6699) · 55444ed6
  Yuan Luo authored Jun 02, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  55444ed6
23 May, 2025 2 commits
- Add fp8 fused_experts kernel for CPU in sgl-kernel and add UT (#6404) · 3ded6235
  Chunyuan WU authored May 23, 2025
  
  3ded6235
- Add fp8 qkv_proj_with_rope kernel for CPU in sgl-kernel and add UT (#6493) · 4ba1eea8
  blzheng authored May 23, 2025
  
  4ba1eea8
22 May, 2025 1 commit

[1/2] Support Qserve (#6457) · 4d643f6c

HandH1998 authored May 22, 2025


Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>

4d643f6c

21 May, 2025 1 commit
- [CPU] Fix build issue (#6419) · cfe48c59
  blzheng authored May 22, 2025
  
  cfe48c59
20 May, 2025 1 commit
- Update extend/decode attention kernel for CPU in sgl-kernel and add UTs (#6405) · 32cc66ef
  YanbingJiang authored May 20, 2025
```
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  32cc66ef
18 May, 2025 1 commit
- Add fp8 shared_expert kernel for CPU in sgl-kernel and add UT (#6339) · 5dd62c3a
  Chunyuan WU authored May 19, 2025
```
Co-authored-by: Jiang, Yanbing <yanbing.jiang@intel.com>
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  5dd62c3a
16 May, 2025 2 commits
- [2/2] Add python wrapper for CUTLASS FP8 Blockscale MoE Kernel. (#5694) · 6fc93575
  Elfie Guo authored May 16, 2025
  
  6fc93575
- Upgrade CUTLASS 4.0 (#6336) · c23a7072
  Elfie Guo authored May 15, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  c23a7072
15 May, 2025 1 commit
- Add fp8 gemm kernel for CPU in sgl-kernel and add gemm UT (#6216) · fb4959b2
  Chunyuan WU authored May 16, 2025
```
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>
Co-authored-by: mingfeima <mingfei.ma@intel.com>
```
  fb4959b2
13 May, 2025 1 commit
- [CPU] Add CMakeLists.txt for sgl-kernel (#6115) · 0f75b907
  blzheng authored May 14, 2025
  
  0f75b907
12 May, 2025 1 commit
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd