Commits · 76139bfba00ed084385e5808ce6bc3bd22da9c47 · change / sglang

23 Jun, 2025 1 commit
- Fix a bug in BatchTokenIDOut & Misc style and dependency updates (#7457) · 55e03b10
  Lianmin Zheng authored Jun 23, 2025
  
  55e03b10
16 Jun, 2025 2 commits
- Release sgl-kernel 0.1.9 (#7232) · 8321f8e4
  Lianmin Zheng authored Jun 16, 2025
  
  8321f8e4
- Fix sampling for speculative decoding & simplify kernels (#7207) · cfceb83d
  Lianmin Zheng authored Jun 16, 2025
  
  cfceb83d
15 Jun, 2025 1 commit
- chore: bump v0.1.8.post2 (#7189) · 44733203
  Yineng Zhang authored Jun 14, 2025
  
  44733203
14 Jun, 2025 1 commit
- [fix] fix cutlass_mla_backend with cuda_graph and add sm_scale for sgl-kernel cutlass_mla (#7184) · ab1a4fa5
  JieXin Liang authored Jun 15, 2025
  
  ab1a4fa5
13 Jun, 2025 3 commits
- chore: bump v0.1.8.post1 (#7152) · 8ab7d93c
  Yineng Zhang authored Jun 13, 2025
  
  8ab7d93c
- Support new DeepGEMM format in per token group quant (#7146) · 5c66c442
  fzyzcjy authored Jun 13, 2025
  
  5c66c442
- Remove 200us slow concat kernel (part 1: kernel) (#7145) · aa46ed34
  fzyzcjy authored Jun 13, 2025
  
  aa46ed34
12 Jun, 2025 2 commits
- feat: update blackwell setup (#7119) · 7046e0fa
  Yineng Zhang authored Jun 12, 2025
  
  7046e0fa
- [sgl-kernel] Add cuda kernel for moe_ep_silu_and_mul (#6919) · 84727a51
  Yuan Luo authored Jun 12, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  84727a51
09 Jun, 2025 1 commit
- [perf][sgl-kernel] extend cutlass_mla_decode to support num_head < 128 (#6929) · 18efb5e8
  JieXin Liang authored Jun 09, 2025
  
  18efb5e8
08 Jun, 2025 1 commit
- chore: bump sgl-kernel v0.1.7 (#6963) · 6c0a4828
  Yineng Zhang authored Jun 08, 2025
  
  6c0a4828
07 Jun, 2025 3 commits
- chore: bump sgl-kernel v0.1.6.post1 (#6955) · 8db3ac55
  Yineng Zhang authored Jun 07, 2025
  
  8db3ac55
- Add a CUDA kernel for fusing mapping and weighted sum for MoE. (#6916) · 3e56f557
  Elfie Guo authored Jun 07, 2025
```
Co-authored-by: Elfie Guo <elfiegxf@gmail.com>
```
  3e56f557
- chore: bump sgl-kernel v0.1.6 (#6943) · d664ca18
  Yineng Zhang authored Jun 07, 2025
  
  d664ca18
05 Jun, 2025 3 commits
- [CUTLASS-FP4-MOE] Introduce CutlassMoEParams class for easy initialization of... · 0df6765c
  Pavani Majety authored Jun 05, 2025
```
[CUTLASS-FP4-MOE]  Introduce CutlassMoEParams class for easy initialization of Cutlass Grouped Gems Metadata (#6887)
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  0df6765c
- [EP] Add cuda kernel for moe_ep_post_reorder (#6837) · 43baba64
  Yuan Luo authored Jun 05, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  43baba64
- support 1 shot allreduce in 1-node and 2-node using mscclpp (#6277) · 8e3797be
  zyksir authored Jun 05, 2025
  
  8e3797be
04 Jun, 2025 2 commits
- Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts... · 81964328
  Cheng Wan authored Jun 04, 2025
```
Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts fusion is not disabled (#6736)
```
  81964328
- [Refactor] Rename `n_share_experts_fusion` as `num_fused_shared_experts` (#6735) · 8a548052
  Cheng Wan authored Jun 03, 2025
  
  8a548052
02 Jun, 2025 2 commits
- [1/2] Add Kernel support for Cutlass based Fused FP4 MoE (#6093) · eb38c7d1
  Pavani Majety authored Jun 02, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  eb38c7d1
- [EP] Add cuda kernel for moe_ep_pre_reorder (#6699) · 55444ed6
  Yuan Luo authored Jun 02, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  55444ed6
01 Jun, 2025 2 commits
- misc: cache is_hopper_arch (#6799) · c429919d
  Wenxuan Tan authored Jun 01, 2025
  
  c429919d
- [Feat] Enable PDL automatically on Hopper architecture (#5981) · 2f7420bc
  Huapeng Zhou authored Jun 01, 2025
  
  2f7420bc
31 May, 2025 1 commit
- chore: bump sgl-kernel v0.1.5 (#6794) · b520d028
  Yineng Zhang authored May 31, 2025
  
  b520d028
22 May, 2025 2 commits
- chore: bump sgl-kernel v0.1.4 (#6522) · d71f3f0a
  Yineng Zhang authored May 22, 2025
  
  d71f3f0a
- [1/2] Support Qserve (#6457) · 4d643f6c
  HandH1998 authored May 22, 2025
```
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
```
  4d643f6c
17 May, 2025 1 commit
- chore: bump sgl-kernel v0.1.3 (#6368) · 3d7f7a43
  Yineng Zhang authored May 17, 2025
  
  3d7f7a43
16 May, 2025 1 commit
- [2/2] Add python wrapper for CUTLASS FP8 Blockscale MoE Kernel. (#5694) · 6fc93575
  Elfie Guo authored May 16, 2025
  
  6fc93575
12 May, 2025 2 commits
- Revert "fix some typos" (#6244) · e8e18dcd
  Lianmin Zheng authored May 12, 2025
  
  e8e18dcd
- fix some typos (#6209) · d738ab52
  applesaucethebun authored May 12, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  d738ab52
11 May, 2025 2 commits
- chore: bump sgl-kernel v0.1.2.post1 (#6195) · 45b4dcf0
  Yineng Zhang authored May 11, 2025
  
  45b4dcf0
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
08 May, 2025 2 commits
- chore: bump sgl-kernel 0.1.2 (#6131) · 6578cf27
  Yineng Zhang authored May 08, 2025
  
  6578cf27
- Remove unecessary is_fa3_supported check (#6112) · 087751a8
  Stefan He authored May 08, 2025
  
  087751a8
30 Apr, 2025 2 commits
- chore: bump sgl-kernel 0.1.1 (#5932) · d353d08b
  Yineng Zhang authored Apr 30, 2025
  
  d353d08b
- [Feat] Scale up fa3 kernel to sm8x arch (#5912) · 08acdb5c
  PGFLMG authored May 01, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  08acdb5c
29 Apr, 2025 1 commit
- [FEATURE] Enhance platform compatibility for ARM (#5746) · 2c7dbb7c
  Johnny authored Apr 30, 2025
  
  2c7dbb7c
28 Apr, 2025 2 commits
- [Feat] QWen-1M context support[1/2]: Update block sparse attention backend utils kernel (#5847) · ee71ed8a
  PGFLMG authored Apr 29, 2025
```
Co-authored-by: sighingnow <sighingnow@gmail.com>
```
  ee71ed8a
- Add Cutlass MLA attention backend (#5390) · 84810da4
  Trevor Morris authored Apr 27, 2025
  
  84810da4