Commits · 0f04a5f428b27b4f011473787de93f3115e832a6 · change / sglang

"official/vision/image_classification/trivial_model.py" did not exist on "5e876e6ed9dd8ecd3095d221e83e70ebdf607454"

22 Sep, 2025 1 commit
- Optimize cutlass int8 gemm kernel for large M on SM89 Ada GPU (#10714) · 0f04a5f4
  Qi Yuhang authored Sep 22, 2025
  
  0f04a5f4
19 Sep, 2025 1 commit

[sgl-kernel] Support moe_sum_reduce cuda kernel (#10321) · 616a3e20

Yuan Luo authored Sep 19, 2025


Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>

616a3e20

18 Sep, 2025 1 commit
- [Feature] Speculative decoding support lookahead (#9873) · e7bc6003
  Zhihao Zhang authored Sep 19, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  e7bc6003
16 Sep, 2025 1 commit
- Update CUTLASS. Refine KernelSchedule for fp8 (grouped) gemm. (#10491) · 9b876889
  Qi Yuhang authored Sep 16, 2025
  
  9b876889
15 Sep, 2025 2 commits
- [1/2] Speed up trtllm_mla attention backend (>10% e2e) (#10473) · 3b25dc12
  fzyzcjy authored Sep 16, 2025
  
  3b25dc12
- Fix correction bias undefined behavior for nvfp4 models (#10426) · 258d02c8
  fzyzcjy authored Sep 15, 2025
  
  258d02c8
13 Sep, 2025 1 commit
- Fix the style of sgl kernel (#10398) · c9ec4cae
  Lianmin Zheng authored Sep 12, 2025
  
  c9ec4cae
11 Sep, 2025 2 commits
- Fix errors of hicache kernels in sgl-kernel for ROCm (#10339) · fe68c148
  Hubert Lu authored Sep 11, 2025
  
  fe68c148
- Revert "[1/2] Optimizations and refactors about quant kernel (#9534)" (#10292) · 6d55f60e
  Yineng Zhang authored Sep 10, 2025
  
  6d55f60e
10 Sep, 2025 2 commits
- pass a_scale from fp8 quant result instead of hard code to 1.0f (#10241) · 2286e85e
  Rain Jiang authored Sep 10, 2025
```
Co-authored-by: Yichen Wang <yichen.wang@bytedance.com>
Co-authored-by: Jinwu Guo <641876696@qq.com>
```
  2286e85e
- Page first direct IO kernel (#10060) · 5be8c2f7
  huangtingwei authored Sep 10, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  5be8c2f7
09 Sep, 2025 2 commits
- Add mamba kernel (#10234) · 8cbe1538
  Yi Zhang authored Sep 10, 2025
  
  8cbe1538
- [CPU] Add gelu_and_mul kernel in sgl-kernel and add ut (#9300) · d1d4074c
  blzheng authored Sep 09, 2025
  
  d1d4074c
08 Sep, 2025 3 commits
- [1/2] Speed up prefill mla attention (#10156) · 0096798e
  fzyzcjy authored Sep 09, 2025
  
  0096798e
- [1/N][Bug] Fix w4afp8 MoE NaN issue (sgl-kernel, fixed) (#10108) · ee0b3c5b
  Yuhao Yao authored Sep 08, 2025
  
  ee0b3c5b
- Add graph runner support with torch compile on CPU (#7843) · 7577f0e4
  Cao E authored Sep 08, 2025
  
  7577f0e4
07 Sep, 2025 2 commits
- Optimize nvfp4 block scaled gemm kernel when M is small. (#10101) · 85ed8e0a
  Qi Yuhang authored Sep 07, 2025
  
  85ed8e0a
- CUTLASS fp8 blockwise gemm support of sm120 (#9969) · dd1e2689
  Jianying authored Sep 07, 2025
  
  dd1e2689
06 Sep, 2025 4 commits
- [chore] Remove unused ep_moe cuda kernels (#9956) · 5f1eb204
  hlu1 authored Sep 06, 2025
  
  5f1eb204
- Disable kernel cutlass_mla_decode on SM103 (#10058) · 4c22ebe2
  hlu1 authored Sep 06, 2025
```
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
```
  4c22ebe2
- [Fix] illegal sync based on undefined behaviour (#9620) · dbb1235d
  DevashishLal-CB authored Sep 05, 2025
```
Signed-off-by: Devashish Lal <devashish@rivosinc.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
```
  dbb1235d
- Revert "[1/N][Bug] Fix w4afp8 MoE NaN issue (sgl-kernel) (#9953)" (#10097) · 0e78c63c
  Yineng Zhang authored Sep 05, 2025
  
  0e78c63c
05 Sep, 2025 2 commits
- Support copying tensor from cpu to gpu without using copy engines (#10007) · bd7f8821
  fzyzcjy authored Sep 05, 2025
  
  bd7f8821
- [1/2] Optimizations and refactors about quant kernel (#9534) · 339f8eef
  fzyzcjy authored Sep 05, 2025
  
  339f8eef
03 Sep, 2025 2 commits
- [1/N][Bug] Fix w4afp8 MoE NaN issue (sgl-kernel) (#9953) · f78b7fd1
  Yuhao Yao authored Sep 03, 2025
  
  f78b7fd1
- Remove annoying warnings in sgl kernel build (#9905) · d631290e
  Lianmin Zheng authored Sep 02, 2025
  
  d631290e
02 Sep, 2025 1 commit
- [feat] Support tp mode for DeepSeek-R1-W4AFP8 (#8118) · d4a93841
  chenxj authored Sep 02, 2025
```
Co-authored-by: yuhyao <827623970@qq.com>
```
  d4a93841
30 Aug, 2025 2 commits
- Make fp4_quantize kernels work on sm103 (#9807) · 1e85589d
  hlu1 authored Aug 29, 2025
```
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
```
  1e85589d
- [NVIDIA] [2/N] Optimize `silu_and_mul_scaled_fp4_grouped_quant` perf (#9556) · 5c34b4f1
  Kaixi Hou authored Aug 29, 2025
  
  5c34b4f1
29 Aug, 2025 2 commits
- Make sm100 fp8 kernels available on sm103 (#9789) · 7a16db9b
  hlu1 authored Aug 28, 2025
```
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
```
  7a16db9b
- Optimize prefill performance on cpu backend (#8750) · 5ad296bd
  Ma Mingfei authored Aug 29, 2025
  
  5ad296bd
28 Aug, 2025 2 commits
- [AMD] Support Hierarchical Caching on AMD GPUs (#8236) · 711390a9
  Hubert Lu authored Aug 28, 2025
  
  711390a9
- Support compile sgl-kernel on cuda 13.0 (#9721) · 6b39f9cf
  Rain Jiang authored Aug 28, 2025
  
  6b39f9cf
27 Aug, 2025 2 commits
- [sgl-kernel] misc: update deepgemm version for sgl-kernel (#9340) · aa3eba8e
  PGFLMG authored Aug 28, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
```
  aa3eba8e
- support cuda 13.0 and trtllm kernel by Aug 25 2025 (#9495) · 79e6a8a6
  Rain Jiang authored Aug 26, 2025
  
  79e6a8a6
25 Aug, 2025 1 commit
- Update CUTLASS 4.2 & Enable K-Major Scale Factor for SM90 FP8 Blockwise Group GEMM (#9559) · fda47926
  Qi Yuhang authored Aug 25, 2025
  
  fda47926
22 Aug, 2025 2 commits
- [NVIDA] [1/N] Nvfp4 Masked Gemm: Add quant op for the flashinfer grouped gemm (#9200) · e5638573
  Kaixi Hou authored Aug 22, 2025
  
  e5638573
- [code clean] add H20 cutlass groupGemm default config (#9333) · 5fd311d3
  kousakawang authored Aug 22, 2025
```
Co-authored-by: wanghanpei <wanghanpei@bytedance.com>
```
  5fd311d3
21 Aug, 2025 1 commit
- [Bug] Fix w4afp8 moe kernel (#9392) · de4990a5
  Yuhao Yao authored Aug 21, 2025
  
  de4990a5
20 Aug, 2025 1 commit
- Add PDL support for quant kernel and rope kernel (#9106) · 42c87045
  fzyzcjy authored Aug 20, 2025
  
  42c87045