Commits · 616a3e20df5faf73a7d1581c7016413f64d583e4 · change / sglang

"vscode:/vscode.git/clone" did not exist on "16fd2fded170f9ea7e16bb5b13f9208f955a7407"

19 Sep, 2025 2 commits
- [sgl-kernel] Support moe_sum_reduce cuda kernel (#10321) · 616a3e20
  Yuan Luo authored Sep 19, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
```
  616a3e20
- chore: bump sgl-kernel 0.3.11 (#10630) · 5bfafdfc
  Yineng Zhang authored Sep 18, 2025
  
  5bfafdfc
18 Sep, 2025 2 commits
- [Feature] Speculative decoding support lookahead (#9873) · e7bc6003
  Zhihao Zhang authored Sep 19, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  e7bc6003
- Fix sgl_kernel import failure on devices other than CUDA (#10610) · 6fd4816d
  Zaili Wang authored Sep 19, 2025
  
  6fd4816d
17 Sep, 2025 1 commit
- CUDA Arch Independent (#8813) · a77564e0
  EduardDurech authored Sep 17, 2025
  
  a77564e0
16 Sep, 2025 1 commit
- support using fa4 on deepseek on blackwell (#9928) · a2f7218a
  cicirori authored Sep 17, 2025
  
  a2f7218a
15 Sep, 2025 3 commits
- chore: bump v0.3.10 sgl-kernel (#10478) · 52074240
  Yineng Zhang authored Sep 15, 2025
  
  52074240
- [1/2] Speed up trtllm_mla attention backend (>10% e2e) (#10473) · 3b25dc12
  fzyzcjy authored Sep 16, 2025
  
  3b25dc12
- Revert "Fix FA4 import cause moe_fused_gate output be illegal memory" (#10432) · ca63f075
  fzyzcjy authored Sep 15, 2025
  
  ca63f075
13 Sep, 2025 1 commit
- Fix the style of sgl kernel (#10398) · c9ec4cae
  Lianmin Zheng authored Sep 12, 2025
  
  c9ec4cae
12 Sep, 2025 1 commit
- Fix FA4 import cause moe_fused_gate output be illegal memory (#10368) · 3a77c80b
  fzyzcjy authored Sep 12, 2025
  
  3a77c80b
11 Sep, 2025 3 commits
- chore: bump sgl-kernel 0.3.9.post2 (#10311) · 532f998b
  Yineng Zhang authored Sep 11, 2025
  
  532f998b
- chore: bump sgl-kernel 0.3.9.post1 (#10294) · 5b7448de
  Yineng Zhang authored Sep 10, 2025
  
  5b7448de
- Revert "[1/2] Optimizations and refactors about quant kernel (#9534)" (#10292) · 6d55f60e
  Yineng Zhang authored Sep 10, 2025
  
  6d55f60e
10 Sep, 2025 1 commit
- Page first direct IO kernel (#10060) · 5be8c2f7
  huangtingwei authored Sep 10, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  5be8c2f7
09 Sep, 2025 3 commits
- Add mamba kernel (#10234) · 8cbe1538
  Yi Zhang authored Sep 10, 2025
  
  8cbe1538
- chore: bump v0.3.9 sgl-kernel (#10208) · f3817cb0
  Yineng Zhang authored Sep 09, 2025
  
  f3817cb0
- feat: support fa cute in sgl-kernel (#10205) · 94fb4e9e
  Yineng Zhang authored Sep 09, 2025
```
Co-authored-by: cicirori <32845984+cicirori@users.noreply.github.com>
```
  94fb4e9e
08 Sep, 2025 1 commit
- [1/2] Speed up prefill mla attention (#10156) · 0096798e
  fzyzcjy authored Sep 09, 2025
  
  0096798e
06 Sep, 2025 1 commit
- [chore] Remove unused ep_moe cuda kernels (#9956) · 5f1eb204
  hlu1 authored Sep 06, 2025
  
  5f1eb204
05 Sep, 2025 2 commits
- Support copying tensor from cpu to gpu without using copy engines (#10007) · bd7f8821
  fzyzcjy authored Sep 05, 2025
  
  bd7f8821
- [1/2] Optimizations and refactors about quant kernel (#9534) · 339f8eef
  fzyzcjy authored Sep 05, 2025
  
  339f8eef
02 Sep, 2025 1 commit
- chore: bump v0.3.8 sgl-kernel (#9907) · a96c5b5c
  Yineng Zhang authored Sep 02, 2025
  
  a96c5b5c
30 Aug, 2025 2 commits
- chore: fix cuda driver api issue and bump sgl-kernel 0.3.7.post1 (#9746) · c5082f0f
  Yineng Zhang authored Aug 30, 2025
  
  c5082f0f
- [NVIDIA] [2/N] Optimize `silu_and_mul_scaled_fp4_grouped_quant` perf (#9556) · 5c34b4f1
  Kaixi Hou authored Aug 29, 2025
  
  5c34b4f1
28 Aug, 2025 1 commit
- [AMD] Support Hierarchical Caching on AMD GPUs (#8236) · 711390a9
  Hubert Lu authored Aug 28, 2025
  
  711390a9
27 Aug, 2025 1 commit
- [sgl-kernel] misc: update deepgemm version for sgl-kernel (#9340) · aa3eba8e
  PGFLMG authored Aug 28, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
```
  aa3eba8e
22 Aug, 2025 2 commits
- [NVIDA] [1/N] Nvfp4 Masked Gemm: Add quant op for the flashinfer grouped gemm (#9200) · e5638573
  Kaixi Hou authored Aug 22, 2025
  
  e5638573
- chore: bump sgl-kernel v0.3.6.post2 (#9475) · b6b2287e
  Yineng Zhang authored Aug 21, 2025
  
  b6b2287e
21 Aug, 2025 1 commit
- Fix FP4 inference corruption issue in glm4.5-air model (#9346) · 70bb066e
  Azure authored Aug 21, 2025
  
  70bb066e
20 Aug, 2025 2 commits
- Add PDL support for quant kernel and rope kernel (#9106) · 42c87045
  fzyzcjy authored Aug 20, 2025
  
  42c87045
- Reduce overhead for fa by not calling heavy CUDA property check (#7375) · c9bf3877
  Yichen Yan authored Aug 20, 2025
  
  c9bf3877
19 Aug, 2025 1 commit
- [Minor] Fix the style of sgl-kernel (#9332) · ecc9f3e4
  Lianmin Zheng authored Aug 18, 2025
  
  ecc9f3e4
18 Aug, 2025 2 commits
- [fix] fix enable_pdl for blackwell (#9011) · 6cdcbcc6
  JieXin Liang authored Aug 19, 2025
  
  6cdcbcc6
- Minor style fixes for sgl-kernel (#9289) · c480a3f6
  Lianmin Zheng authored Aug 18, 2025
  
  c480a3f6
17 Aug, 2025 1 commit
- chore: bump sgl-kernel v0.3.6.post1 (#9286) · a1c7f742
  Yineng Zhang authored Aug 17, 2025
  
  a1c7f742
16 Aug, 2025 1 commit
- Revert "chore: bump sgl-kernel v0.3.6 (#9220)" (#9247) · 87dab548
  Yineng Zhang authored Aug 15, 2025
  
  87dab548
15 Aug, 2025 2 commits
- Optional extension for green context (#9231) · 0c8594e6
  Liangsheng Yin authored Aug 15, 2025
  
  0c8594e6
- chore: bump sgl-kernel v0.3.6 (#9220) · c186feed
  Yineng Zhang authored Aug 15, 2025
  
  c186feed
14 Aug, 2025 1 commit
- [sgl-kernel] Support FlashInfer top_k_top_p_sampling_from_logits (#9060) · 53dcc750
  Yuan Luo authored Aug 15, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  53dcc750