Commits · 11421a3f44b95f706be0ba10016d0c2863cc0c4a · change / sglang

13 Apr, 2025 1 commit
- feat: adapt merge_state (#5337) · b62e7e99
  Yineng Zhang authored Apr 12, 2025
  
  b62e7e99
12 Apr, 2025 1 commit
- Blackwell Cutlass MLA kernel (#5142) · f65b8d5c
  Trevor Morris authored Apr 11, 2025
  
  f65b8d5c
11 Apr, 2025 1 commit
- fix: remove cublas_grouped_gemm (#5307) · 136b8e6a
  Yineng Zhang authored Apr 11, 2025
  
  136b8e6a
29 Mar, 2025 1 commit
- Add deepseek style fused moe group gate selection kernel (#4530) · 45dcfc2e
  Qingquan Song authored Mar 29, 2025
  
  45dcfc2e
25 Mar, 2025 1 commit
- Support FP4 gemm (1/2) (#3899) · e9f8e423
  Trevor Morris authored Mar 24, 2025
  
  e9f8e423
24 Mar, 2025 1 commit
- [Quant Kernel] refactored per token group quant fp8 to support int8 up-to 2x faster (#4396) · 65c24c28
  Chunan Zeng authored Mar 23, 2025
  
  65c24c28
16 Mar, 2025 1 commit
- Add greedy verification kernel (#4383) · 52a34d74
  Ying Sheng authored Mar 16, 2025
  
  52a34d74
14 Mar, 2025 1 commit
- Add moe topk softmax templated from vllm (#4302) · 61e4433c
  Qingquan Song authored Mar 14, 2025
  
  61e4433c
12 Mar, 2025 1 commit
- Add awq dequantize kernel to sgl with 1x to 3x speedup (#4104) · 07f94463
  Rex authored Mar 12, 2025
  
  07f94463
09 Mar, 2025 1 commit
- Rename files in sgl kernel to avoid nested folder structure (#4213) · 8abf74e3
  Lianmin Zheng authored Mar 08, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  8abf74e3
07 Mar, 2025 2 commits
- Add sgl_per_token_quant_fp8 (#4089) · 63ee26d1
  Stefan He authored Mar 06, 2025
  
  63ee26d1
- [quant kernel] sgl-kernel support per_tensor_quant fp8 (#3786) · ad55f171
  Xiaoyu Zhang authored Mar 07, 2025
  
  ad55f171
03 Mar, 2025 3 commits
- Reorganize python source files in sgl-kernel with multiple files (#4027) · 110e0066
  Lianmin Zheng authored Mar 03, 2025
  
  110e0066
- Improve code styles (#4021) · 66301e12
  Lianmin Zheng authored Mar 03, 2025
  
  66301e12
- Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727
  Lianmin Zheng authored Mar 03, 2025
```
Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>
```
  ac238727
02 Mar, 2025 1 commit
- Enable custom AR for AMD GPUs and maintain it in sgl-kernel (#3406) · 9cf40772
  Hubert Lu authored Mar 02, 2025
  
  9cf40772
18 Feb, 2025 1 commit
- [Feature] Apply Cublas Grouped Gemm kernel (#3629) · 67fc595b
  Baizhou Zhang authored Feb 17, 2025
  
  67fc595b
12 Feb, 2025 1 commit
- support blockwise fp8 matmul kernel (#3267) · 640363ad
  yizhang2077 authored Feb 13, 2025
  
  640363ad
11 Feb, 2025 1 commit
- optimize per token group quant fp8 (#3490) · bb418ced
  Xiaoyu Zhang authored Feb 11, 2025
  
  bb418ced
09 Feb, 2025 1 commit
- support version in sgl-kernel (#3439) · 4cfd3add
  Yineng Zhang authored Feb 10, 2025
  
  4cfd3add
07 Feb, 2025 2 commits
- support speculative decoding kernel in sgl-kernel (#3373) · f9905d59
  Yineng Zhang authored Feb 07, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  f9905d59
- fix undefined symbol cudaGetDriverEntryPointByVersion (#3372) · 45c87e08
  Yineng Zhang authored Feb 07, 2025
  
  45c87e08
27 Jan, 2025 2 commits
- cleanup sgl-kernel kernels (#3175) · 827aa873
  Yineng Zhang authored Jan 27, 2025
  
  827aa873
- [kernel] Integrate flashinfer's rope with higher precision and better perf (#3134) · fb11a439
  Byron Hsu authored Jan 26, 2025
  
  fb11a439
26 Jan, 2025 1 commit
- support w8a8 fp8 kernel with CUTLASS (#3047) · 82392da8
  HandH1998 authored Jan 26, 2025
```
Co-authored-by: yych0745 <1398089567@qq.com>
```
  82392da8
23 Jan, 2025 2 commits
- feat: integrate sampling kernels into sgl-kernel (#3086) · 5de4051b
  Yineng Zhang authored Jan 24, 2025
```
Co-authored-by: Zihao Ye <expye@outlook.com>
```
  5de4051b
- support lightning_attention_decode in sgl-kernel for MiniMax-Text-01 (#3030) · ac2dc35d
  Xiaoyu Zhang authored Jan 23, 2025
  
  ac2dc35d
22 Jan, 2025 3 commits
- feat: integrate bmm_fp8 kernel into sgl-kernel (#3056) · bf669606
  Yineng Zhang authored Jan 23, 2025
  
  bf669606
- feat: integrate activation kernels into sgl-kernel (#3053) · 9d9b482a
  Yineng Zhang authored Jan 22, 2025
  
  9d9b482a
- feat: integrate norm kernels into sgl-kernel (#3052) · 7353fb9b
  Yineng Zhang authored Jan 22, 2025
  
  7353fb9b
21 Jan, 2025 1 commit
- feat: add flashinfer as 3rdparty and use rmsnorm as example (#3033) · 5a0d680a
  Yineng Zhang authored Jan 21, 2025
  
  5a0d680a
20 Jan, 2025 1 commit
- [kernel] port rope cuda kernel to sgl-kernel (#2993) · b5caa22d
  Byron Hsu authored Jan 20, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  b5caa22d
15 Jan, 2025 1 commit
- optimize custom allreduce kernel (#2904) · 6cb3974e
  yizhang2077 authored Jan 16, 2025
  
  6cb3974e
13 Jan, 2025 1 commit
- add sampling_scaling_penalties kernel (#2846) · e2b16c47
  Xiaoyu Zhang authored Jan 13, 2025
  
  e2b16c47
06 Jan, 2025 1 commit
- Support cutlass Int8 gemm (#2752) · 0f3eb1d2
  Ke Bao authored Jan 06, 2025
  
  0f3eb1d2
31 Dec, 2024 1 commit
- minor: cleanup sgl-kernel (#2679) · b6b57fc2
  Yineng Zhang authored Dec 31, 2024
  
  b6b57fc2
30 Dec, 2024 1 commit
- Refactor sgl-kernel build (#2642) · b02da24a
  Ke Bao authored Dec 30, 2024
  
  b02da24a
26 Dec, 2024 1 commit
- fix: only enable moe_align_block_size for now (#2590) · 2dccecf4
  Yineng Zhang authored Dec 26, 2024
  
  2dccecf4
25 Dec, 2024 1 commit
- fix moe_align_block_size_kernel for shared memory issue (#2579) · 31548116
  Yineng Zhang authored Dec 26, 2024
```
Co-authored-by: ispobock <ispobaoke@163.com>
```
  31548116
15 Dec, 2024 1 commit
- adapt tensorrt llm custom all reduce to sgl-kernel (#2481) · e04d3f28
  yizhang2077 authored Dec 15, 2024
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  e04d3f28