Commits · 07ab4d4a2df2ca28cfa82197e6a692a0f69c1d02 · change / sglang

12 Feb, 2025 1 commit
- support blockwise fp8 matmul kernel (#3267) · 640363ad
  yizhang2077 authored Feb 13, 2025
  
  640363ad
11 Feb, 2025 1 commit
- optimize per token group quant fp8 (#3490) · bb418ced
  Xiaoyu Zhang authored Feb 11, 2025
  
  bb418ced
09 Feb, 2025 1 commit
- fix cu118 link issue (#3421) · 29daf498
  Yineng Zhang authored Feb 09, 2025
  
  29daf498
07 Feb, 2025 1 commit
- support speculative decoding kernel in sgl-kernel (#3373) · f9905d59
  Yineng Zhang authored Feb 07, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  f9905d59
03 Feb, 2025 1 commit
- add copyright for sgl-kernel (#3270) · 00fa7d04
  Yineng Zhang authored Feb 03, 2025
  
  00fa7d04
31 Jan, 2025 1 commit
- revert the MoE dependence (#3230) · 3ee62235
  Yineng Zhang authored Jan 31, 2025
  
  3ee62235
30 Jan, 2025 2 commits
- add tensorrt_llm common and cutlass_extensions as 3rdparty (#3216) · 222ce6f1
  Yineng Zhang authored Jan 30, 2025
```
Co-authored-by: BBuf <35585791+BBuf@users.noreply.github.com>
```
  222ce6f1
- update setup for sgl-kernel (#3214) · 468d23cf
  Yineng Zhang authored Jan 30, 2025
  
  468d23cf
27 Jan, 2025 3 commits
- cleanup sgl-kernel kernels (#3175) · 827aa873
  Yineng Zhang authored Jan 27, 2025
  
  827aa873
- Improve weight loading and code style (#3174) · 53cef815
  Lianmin Zheng authored Jan 27, 2025
  
  53cef815
- [kernel] Integrate flashinfer's rope with higher precision and better perf (#3134) · fb11a439
  Byron Hsu authored Jan 26, 2025
  
  fb11a439
26 Jan, 2025 4 commits
- use self-hosted to build sgl-kernel (#3154) · f265d15b
  Yineng Zhang authored Jan 26, 2025
  
  f265d15b
- fix link in README (#3153) · 02431b9a
  Yineng Zhang authored Jan 26, 2025
  
  02431b9a
- support w8a8 fp8 kernel with CUTLASS (#3047) · 82392da8
  HandH1998 authored Jan 26, 2025
```
Co-authored-by: yych0745 <1398089567@qq.com>
```
  82392da8
- minor: cleanup sgl-kernel (#3143) · 95f789ad
  Yineng Zhang authored Jan 26, 2025
  
  95f789ad
25 Jan, 2025 1 commit

feat: refactor sgl-kernel and use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#3130) · 9286740e

yinfan98 authored Jan 26, 2025


Co-authored-by: yinfan.1024 <yinfan.1024@bytedance.com>
Co-authored-by: yinfan98 <1106110035@qq.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

9286740e

24 Jan, 2025 3 commits
- minor: update sgl-kernel setup (#3107) · 04f0b4cb
  Yineng Zhang authored Jan 24, 2025
  
  04f0b4cb
- Allow local cutlass directory to be used in sgl-kernel build (#3037) · 685a5738
  Trevor Morris authored Jan 24, 2025
  
  685a5738
- Fix cu118 group gemm compile issue (#3097) · 6619f48e
  Ke Bao authored Jan 24, 2025
  
  6619f48e
23 Jan, 2025 5 commits
- feat: integrate sampling kernels into sgl-kernel (#3086) · 5de4051b
  Yineng Zhang authored Jan 24, 2025
```
Co-authored-by: Zihao Ye <expye@outlook.com>
```
  5de4051b
- use env variable to control the build conf on the CPU build node (#3080) · 07a22cbb
  Yineng Zhang authored Jan 23, 2025
  
  07a22cbb
- update version setup for sgl-kernel (#3079) · 3d0bfa3e
  Yineng Zhang authored Jan 23, 2025
  
  3d0bfa3e
- Remove torch dependency in sgl-kernel (#3074) · 553f5a3f
  Lianmin Zheng authored Jan 23, 2025
  
  553f5a3f
- support lightning_attention_decode in sgl-kernel for MiniMax-Text-01 (#3030) · ac2dc35d
  Xiaoyu Zhang authored Jan 23, 2025
  
  ac2dc35d
22 Jan, 2025 4 commits
- feat: integrate bmm_fp8 kernel into sgl-kernel (#3056) · bf669606
  Yineng Zhang authored Jan 23, 2025
  
  bf669606
- sync the upstream updates of flashinfer (#3051) · bcda0c9e
  Yineng Zhang authored Jan 22, 2025
  
  bcda0c9e
- update norm cu (#3048) · 9f8f2c7f
  Yineng Zhang authored Jan 22, 2025
  
  9f8f2c7f
- Fix sgl-kernel compile for sm80 (#3046) · 6fc37bd8
  Ke Bao authored Jan 22, 2025
  
  6fc37bd8
21 Jan, 2025 1 commit
- feat: add flashinfer as 3rdparty and use rmsnorm as example (#3033) · 5a0d680a
  Yineng Zhang authored Jan 21, 2025
  
  5a0d680a
20 Jan, 2025 2 commits
- Add compile flags for cutlass 3.x (#3013) · 5dfcacfc
  Ke Bao authored Jan 21, 2025
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  5dfcacfc
- [kernel] port rope cuda kernel to sgl-kernel (#2993) · b5caa22d
  Byron Hsu authored Jan 20, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  b5caa22d
18 Jan, 2025 1 commit
- fix sgl-kernel setup.py (#2963) · 6f98c586
  lukec authored Jan 18, 2025
  
  6f98c586
16 Jan, 2025 1 commit
- fix setup for sgl kernel (#2917) · 2dc957d4
  Yineng Zhang authored Jan 16, 2025
  
  2dc957d4
15 Jan, 2025 2 commits
- fix: sgl-kernel link cuda (#2906) · a53454c5
  Yineng Zhang authored Jan 16, 2025
  
  a53454c5
- optimize custom allreduce kernel (#2904) · 6cb3974e
  yizhang2077 authored Jan 16, 2025
  
  6cb3974e
13 Jan, 2025 1 commit
- add sampling_scaling_penalties kernel (#2846) · e2b16c47
  Xiaoyu Zhang authored Jan 13, 2025
  
  e2b16c47
06 Jan, 2025 1 commit
- Support cutlass Int8 gemm (#2752) · 0f3eb1d2
  Ke Bao authored Jan 06, 2025
  
  0f3eb1d2
31 Dec, 2024 2 commits
- minor: cleanup sgl-kernel (#2679) · b6b57fc2
  Yineng Zhang authored Dec 31, 2024
  
  b6b57fc2
- Add cutlass submodule for sgl-kernel (#2676) · b4403985
  Ke Bao authored Dec 31, 2024
  
  b4403985
30 Dec, 2024 1 commit
- Refactor sgl-kernel build (#2642) · b02da24a
  Ke Bao authored Dec 30, 2024
  
  b02da24a