Commits · afd9f2f560a1d169d4804d0a6904a62355aefdcf · change / sglang · GitLab

03 Sep, 2025 1 commit
- Remove annoying warnings in sgl kernel build (#9905) · d631290e
  Lianmin Zheng authored Sep 02, 2025
  
  d631290e
30 Aug, 2025 2 commits
- Make fp4_quantize kernels work on sm103 (#9807) · 1e85589d
  hlu1 authored Aug 29, 2025
```
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
```
  1e85589d
- [NVIDIA] [2/N] Optimize `silu_and_mul_scaled_fp4_grouped_quant` perf (#9556) · 5c34b4f1
  Kaixi Hou authored Aug 29, 2025
  
  5c34b4f1
29 Aug, 2025 1 commit
- Make sm100 fp8 kernels available on sm103 (#9789) · 7a16db9b
  hlu1 authored Aug 28, 2025
```
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
```
  7a16db9b
22 Aug, 2025 1 commit
- [NVIDA] [1/N] Nvfp4 Masked Gemm: Add quant op for the flashinfer grouped gemm (#9200) · e5638573
  Kaixi Hou authored Aug 22, 2025
  
  e5638573
18 Aug, 2025 1 commit
- [AMD] Reorganize hip-related header files in sgl-kernel (#9320) · c6c379ab
  Hubert Lu authored Aug 18, 2025
  
  c6c379ab
15 Aug, 2025 1 commit
- Fp4 MOE quant kernel optimization (#8777) · 4fc09e0d
  jy-song-hub authored Aug 15, 2025
```
Co-authored-by: Rain Jiang <96632942+rainj-me@users.noreply.github.com>
```
  4fc09e0d
14 Aug, 2025 3 commits
- [sgl-kernel] 1/N Refactor sglang cutlass 3x - gemm fp8 blockwise sm90 (#8913) · 432f2053
  Yuan Luo authored Aug 15, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  432f2053
- [2/n]decouple quantization implementation from vLLM dependency (#8112) · 5aa1ebd2
  Peng Zhang authored Aug 14, 2025
```
Co-authored-by: walker-ai <yiyun.wyt@antgroup.com>
Co-authored-by: leoneo <1320612015@qq.com>
```
  5aa1ebd2
- [Perf] Tunings for SM100 FP8 CUTLASS kernel (#8818) · 841810f2
  henryg authored Aug 13, 2025
  
  841810f2
08 Aug, 2025 1 commit
- Fix typos and unify size(s)/stride(s) API calls (#8799) · 44401358
  triple-mu authored Aug 08, 2025
  
  44401358
04 Aug, 2025 1 commit
- [sgl-kernel] avoid per_token_quant_fp8.cu hardcode sm_count (#8738) · f57d2dc1
  Xiaoyu Zhang authored Aug 04, 2025
  
  f57d2dc1
01 Aug, 2025 2 commits
- fix per token cuda kernel hidden dim cannot divide by 16 (#8543) · db7343c9
  Stefan He authored Aug 01, 2025
  
  db7343c9
- [Kimi K2] dsv3_router_gemm supports NUM_EXPERTS == 384 (#8013) · 6bdd2786
  Peter Pan authored Aug 01, 2025
  
  6bdd2786
29 Jul, 2025 1 commit

[sgl-kernel performace] fix fp8 quant kernels dispatch __nv_fp8_e4m3 bug to... · 7a4309cc

Xiaoyu Zhang authored Jul 29, 2025


[sgl-kernel performace] fix fp8 quant kernels dispatch __nv_fp8_e4m3 bug to improve performance 10%-20% (#8499)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>

7a4309cc

28 Jul, 2025 1 commit
- Fix per_token_group_quant_8bit when hidden_dim // group_size is not divided by 4. (#8449) · fb4ce17d
  strgrb authored Jul 28, 2025
```
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
```
  fb4ce17d
23 Jul, 2025 1 commit
- [sgl-kernel] Opt per_token_quant_fp8 with warp reduce (#8130) · 0c8dab9e
  Yuan Luo authored Jul 23, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  0c8dab9e
20 Jul, 2025 1 commit
- Add bf16 output option for dsv3_router_gemm kernel (#7999) · 282eb59f
  Baizhou Zhang authored Jul 19, 2025
  
  282eb59f
18 Jul, 2025 1 commit
- [Fix][Ready]Fix register spilling in cutlass nvfp4 gemm kernel on Blackwell (#8127) · 6e92da8f
  Qi Yuhang authored Jul 18, 2025
  
  6e92da8f
10 Jul, 2025 1 commit
- Fix bug of deepseek-v3 under DP+EP mode with large batchsize/seqlen (#6449) · 4a0d1919
  likesen-alibaba authored Jul 10, 2025
  
  4a0d1919
30 Jun, 2025 1 commit
- Add dsv3 router gemm kernel (#7627) · 7248272c
  Baizhou Zhang authored Jun 29, 2025
  
  7248272c
29 Jun, 2025 1 commit
- Add dsv3 fused a gemm to sgl-kernel (#7630) · 04b35190
  Ke Bao authored Jun 29, 2025
  
  04b35190
17 Jun, 2025 1 commit
- Fix AWQ Dequant and Weight Loading of deepseek v2 (#6842) · 3eb4a800
  AniZpZ authored Jun 18, 2025
  
  3eb4a800
13 Jun, 2025 1 commit
- Support new DeepGEMM format in per token group quant (#7146) · 5c66c442
  fzyzcjy authored Jun 13, 2025
  
  5c66c442
02 Jun, 2025 1 commit
- [1/2] Add Kernel support for Cutlass based Fused FP4 MoE (#6093) · eb38c7d1
  Pavani Majety authored Jun 02, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  eb38c7d1
22 May, 2025 1 commit

[1/2] Support Qserve (#6457) · 4d643f6c

HandH1998 authored May 22, 2025


Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>

4d643f6c

16 May, 2025 1 commit
- Upgrade CUTLASS 4.0 (#6336) · c23a7072
  Elfie Guo authored May 15, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  c23a7072
06 May, 2025 1 commit
- chore: upgrade cutlass 3.9.2 (#6004) · 6f566147
  Yineng Zhang authored May 06, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  6f566147
29 Apr, 2025 1 commit
- cutlass 3.9 supported to improve fp8_blockwise_gemm (#5820) · 5bb0accb
  Xiaoyu Zhang authored Apr 29, 2025
  
  5bb0accb
11 Apr, 2025 1 commit
- fix: remove cublas_grouped_gemm (#5307) · 136b8e6a
  Yineng Zhang authored Apr 11, 2025
  
  136b8e6a
09 Apr, 2025 1 commit
- sgl-kernel use cutlass latest version for fp8 blockwise gemm (#5207) · ebf495f0
  Yi Zhang authored Apr 10, 2025
  
  ebf495f0
03 Apr, 2025 1 commit
- [sgl-kernel] per token group quant support COLUMN MAJOR (#4817) · 2c8fd993
  Xiaoyu Zhang authored Apr 03, 2025
  
  2c8fd993
31 Mar, 2025 1 commit
- [Build] Fix cuda12.8 build error in nvfp4_scaled_mm_kernels.cu (#4953) · ee47a6c1
  Yuhong Guo authored Apr 01, 2025
  
  ee47a6c1
29 Mar, 2025 1 commit
- fix sgl-kernel cu118 build (#4872) · ec3ee028
  Yineng Zhang authored Mar 28, 2025
  
  ec3ee028
27 Mar, 2025 1 commit

support cmake for sgl-kernel (#4706) · 8bf6d7f4

Yineng Zhang authored Mar 27, 2025


Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: yinfan98 <1106310035@qq.com>

8bf6d7f4

26 Mar, 2025 1 commit
- Fix shared memory OOM on sm86 GPUs. (#4797) · 45fdf1f7
  Yi Pan authored Mar 27, 2025
  
  45fdf1f7
25 Mar, 2025 1 commit
- Support FP4 gemm (1/2) (#3899) · e9f8e423
  Trevor Morris authored Mar 24, 2025
  
  e9f8e423
24 Mar, 2025 1 commit
- [Quant Kernel] refactored per token group quant fp8 to support int8 up-to 2x faster (#4396) · 65c24c28
  Chunan Zeng authored Mar 23, 2025
  
  65c24c28
22 Mar, 2025 2 commits
- [1/3] fix dsv3 awq issue (#4556) · 321ab756
  AniZpZ authored Mar 22, 2025
```
Co-authored-by: leoneo <1320612015@qq.com>
```
  321ab756
- Speed up per token and per tensor quant by 15% (#4639) · 6a384d5c
  Chunan Zeng authored Mar 22, 2025
  
  6a384d5c