Commits · 813670660c29d809e38d1444f65da7a2c2820163 · change / sglang · GitLab

28 Jul, 2025 1 commit
- Fix per_token_group_quant_8bit when hidden_dim // group_size is not divided by 4. (#8449) · fb4ce17d
  strgrb authored Jul 28, 2025
```
Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>
```
  fb4ce17d
23 Jul, 2025 1 commit
- [sgl-kernel] Opt per_token_quant_fp8 with warp reduce (#8130) · 0c8dab9e
  Yuan Luo authored Jul 23, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  0c8dab9e
20 Jul, 2025 1 commit
- Add bf16 output option for dsv3_router_gemm kernel (#7999) · 282eb59f
  Baizhou Zhang authored Jul 19, 2025
  
  282eb59f
18 Jul, 2025 1 commit
- [Fix][Ready]Fix register spilling in cutlass nvfp4 gemm kernel on Blackwell (#8127) · 6e92da8f
  Qi Yuhang authored Jul 18, 2025
  
  6e92da8f
10 Jul, 2025 1 commit
- Fix bug of deepseek-v3 under DP+EP mode with large batchsize/seqlen (#6449) · 4a0d1919
  likesen-alibaba authored Jul 10, 2025
  
  4a0d1919
30 Jun, 2025 1 commit
- Add dsv3 router gemm kernel (#7627) · 7248272c
  Baizhou Zhang authored Jun 29, 2025
  
  7248272c
29 Jun, 2025 1 commit
- Add dsv3 fused a gemm to sgl-kernel (#7630) · 04b35190
  Ke Bao authored Jun 29, 2025
  
  04b35190
17 Jun, 2025 1 commit
- Fix AWQ Dequant and Weight Loading of deepseek v2 (#6842) · 3eb4a800
  AniZpZ authored Jun 18, 2025
  
  3eb4a800
13 Jun, 2025 1 commit
- Support new DeepGEMM format in per token group quant (#7146) · 5c66c442
  fzyzcjy authored Jun 13, 2025
  
  5c66c442
02 Jun, 2025 1 commit
- [1/2] Add Kernel support for Cutlass based Fused FP4 MoE (#6093) · eb38c7d1
  Pavani Majety authored Jun 02, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  eb38c7d1
22 May, 2025 1 commit

[1/2] Support Qserve (#6457) · 4d643f6c

HandH1998 authored May 22, 2025


Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>

4d643f6c

16 May, 2025 1 commit
- Upgrade CUTLASS 4.0 (#6336) · c23a7072
  Elfie Guo authored May 15, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  c23a7072
06 May, 2025 1 commit
- chore: upgrade cutlass 3.9.2 (#6004) · 6f566147
  Yineng Zhang authored May 06, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  6f566147
29 Apr, 2025 1 commit
- cutlass 3.9 supported to improve fp8_blockwise_gemm (#5820) · 5bb0accb
  Xiaoyu Zhang authored Apr 29, 2025
  
  5bb0accb
11 Apr, 2025 1 commit
- fix: remove cublas_grouped_gemm (#5307) · 136b8e6a
  Yineng Zhang authored Apr 11, 2025
  
  136b8e6a
09 Apr, 2025 1 commit
- sgl-kernel use cutlass latest version for fp8 blockwise gemm (#5207) · ebf495f0
  Yi Zhang authored Apr 10, 2025
  
  ebf495f0
03 Apr, 2025 1 commit
- [sgl-kernel] per token group quant support COLUMN MAJOR (#4817) · 2c8fd993
  Xiaoyu Zhang authored Apr 03, 2025
  
  2c8fd993
31 Mar, 2025 1 commit
- [Build] Fix cuda12.8 build error in nvfp4_scaled_mm_kernels.cu (#4953) · ee47a6c1
  Yuhong Guo authored Apr 01, 2025
  
  ee47a6c1
29 Mar, 2025 1 commit
- fix sgl-kernel cu118 build (#4872) · ec3ee028
  Yineng Zhang authored Mar 28, 2025
  
  ec3ee028
27 Mar, 2025 1 commit

support cmake for sgl-kernel (#4706) · 8bf6d7f4

Yineng Zhang authored Mar 27, 2025


Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: yinfan98 <1106310035@qq.com>

8bf6d7f4

26 Mar, 2025 1 commit
- Fix shared memory OOM on sm86 GPUs. (#4797) · 45fdf1f7
  Yi Pan authored Mar 27, 2025
  
  45fdf1f7
25 Mar, 2025 1 commit
- Support FP4 gemm (1/2) (#3899) · e9f8e423
  Trevor Morris authored Mar 24, 2025
  
  e9f8e423
24 Mar, 2025 1 commit
- [Quant Kernel] refactored per token group quant fp8 to support int8 up-to 2x faster (#4396) · 65c24c28
  Chunan Zeng authored Mar 23, 2025
  
  65c24c28
22 Mar, 2025 2 commits
- [1/3] fix dsv3 awq issue (#4556) · 321ab756
  AniZpZ authored Mar 22, 2025
```
Co-authored-by: leoneo <1320612015@qq.com>
```
  321ab756
- Speed up per token and per tensor quant by 15% (#4639) · 6a384d5c
  Chunan Zeng authored Mar 22, 2025
  
  6a384d5c
20 Mar, 2025 1 commit
- Support fp8 gemm for blackwell (#4558) · ad4e58bf
  Shu Wang authored Mar 20, 2025
  
  ad4e58bf
17 Mar, 2025 1 commit
- Support serving DeepSeek-R1-Channel-INT8 with 32 L40S. (#4418) · 75b65648
  Wenbo Yang authored Mar 17, 2025
  
  75b65648
13 Mar, 2025 2 commits
- fix accuracy issue (#4376) · 2937387a
  Yineng Zhang authored Mar 13, 2025
  
  2937387a
- Fix per token fp8 quant precision (#4362) · 4068e012
  Qingquan Song authored Mar 12, 2025
  
  4068e012
12 Mar, 2025 3 commits
- Support Blackwell Block Scale FP8 Gemm (#4278) · 7c866711
  Elfie Guo authored Mar 12, 2025
  
  7c866711
- Add awq dequantize kernel to sgl with 1x to 3x speedup (#4104) · 07f94463
  Rex authored Mar 12, 2025
  
  07f94463
- Remove vllm ops scaled fp8 quant and accelerate per token quant by 20-28% (#4215) · e0917e6b
  Stefan He authored Mar 12, 2025
```
Co-authored-by: Stefan He <bhe@linkedin.com>
```
  e0917e6b
10 Mar, 2025 3 commits
- fix per_token_group_quant_fp8 illegal memory when num_groups % 16 != 0 (#4231) · 23308a90
  Xiaoyu Zhang authored Mar 10, 2025
  
  23308a90
- Simplify tests & Fix trtllm custom allreduce registration (#4252) · aa957102
  Lianmin Zheng authored Mar 10, 2025
  
  aa957102
- Move rope and bmm into sgl-kernel (#4241) · eb06dbcb
  Lianmin Zheng authored Mar 09, 2025
  
  eb06dbcb
09 Mar, 2025 1 commit
- Rename files in sgl kernel to avoid nested folder structure (#4213) · 8abf74e3
  Lianmin Zheng authored Mar 08, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  8abf74e3