Commits · 6702592d0e6b61c9fdad211a0c5ef9999dcdae40 · change / sglang · GitLab

07 Feb, 2025 2 commits
- support speculative decoding kernel in sgl-kernel (#3373) · f9905d59
  Yineng Zhang authored Feb 07, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  f9905d59
- fix undefined symbol cudaGetDriverEntryPointByVersion (#3372) · 45c87e08
  Yineng Zhang authored Feb 07, 2025
  
  45c87e08
06 Feb, 2025 3 commits
- optimize moe_align_kernel cuda (#3347) · cdae77b0
  Xiaoyu Zhang authored Feb 07, 2025
  
  cdae77b0
- fix sgl-kernel build failure on AMD (#3352) · adeee152
  Yineng Zhang authored Feb 07, 2025
  
  adeee152
- clean moe align block kernel code and add acc test (#3332) · ad349985
  Xiaoyu Zhang authored Feb 06, 2025
  
  ad349985
04 Feb, 2025 1 commit
- ROCm: sgl-kernel enablement starting with sgl_moe_align_block (#3287) · 2c1a695f
  HAI authored Feb 04, 2025
  
  2c1a695f
03 Feb, 2025 1 commit
- add copyright for sgl-kernel (#3270) · 00fa7d04
  Yineng Zhang authored Feb 03, 2025
  
  00fa7d04
31 Jan, 2025 2 commits
- update cutlass dependency (#3240) · 7876279e
  Yineng Zhang authored Feb 01, 2025
  
  7876279e
- revert the MoE dependence (#3230) · 3ee62235
  Yineng Zhang authored Jan 31, 2025
  
  3ee62235
30 Jan, 2025 5 commits
- keep the parts needed for moe_kernels (#3218) · 9602c2aa
  Yineng Zhang authored Jan 31, 2025
  
  9602c2aa
- add tensorrt_llm moe_gemm as 3rdparty (#3217) · e81d7f11
  Yineng Zhang authored Jan 30, 2025
  
  e81d7f11
- add tensorrt_llm common and cutlass_extensions as 3rdparty (#3216) · 222ce6f1
  Yineng Zhang authored Jan 30, 2025
```
Co-authored-by: BBuf <35585791+BBuf@users.noreply.github.com>
```
  222ce6f1
- update setup for sgl-kernel (#3214) · 468d23cf
  Yineng Zhang authored Jan 30, 2025
  
  468d23cf
- update 3rdparty and rms norm for sgl-kernel (#3213) · c38b5fb4
  Yineng Zhang authored Jan 30, 2025
  
  c38b5fb4
28 Jan, 2025 1 commit
- clean up useless file (#3192) · 81262c7b
  Xiaoyu Zhang authored Jan 28, 2025
  
  81262c7b
27 Jan, 2025 6 commits
- chore: bump 0.0.3 for sgl-kernel (#3178) · 8a96f749
  Yineng Zhang authored Jan 27, 2025
```
Co-authored-by: ispobock <ispobaoke@hotmail.com>
Co-authored-by: BBuf <35585791+BBuf@users.noreply.github.com>
Co-authored-by: HandH1998 <007aabbcc411@gmail.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: ByronHsu <byronhsu1230@gmail.com>
```
  8a96f749
- cleanup sgl-kernel kernels (#3175) · 827aa873
  Yineng Zhang authored Jan 27, 2025
  
  827aa873
- Improve weight loading and code style (#3174) · 53cef815
  Lianmin Zheng authored Jan 27, 2025
  
  53cef815
- [kernel] Fix position ids in rope (#3173) · 514f37c3
  Byron Hsu authored Jan 27, 2025
  
  514f37c3
- Bump sgl kernel to 0.0.2.post19 (#3167) · 741fccd7
  Byron Hsu authored Jan 26, 2025
  
  741fccd7
- [kernel] Integrate flashinfer's rope with higher precision and better perf (#3134) · fb11a439
  Byron Hsu authored Jan 26, 2025
  
  fb11a439
26 Jan, 2025 5 commits
- use self-hosted to build sgl-kernel (#3154) · f265d15b
  Yineng Zhang authored Jan 26, 2025
  
  f265d15b
- fix link in README (#3153) · 02431b9a
  Yineng Zhang authored Jan 26, 2025
  
  02431b9a
- chore: bump 0.0.2.post18 for sgl-kernel (#3149) · 318260c0
  Yineng Zhang authored Jan 26, 2025
  
  318260c0
- support w8a8 fp8 kernel with CUTLASS (#3047) · 82392da8
  HandH1998 authored Jan 26, 2025
```
Co-authored-by: yych0745 <1398089567@qq.com>
```
  82392da8
- minor: cleanup sgl-kernel (#3143) · 95f789ad
  Yineng Zhang authored Jan 26, 2025
  
  95f789ad
25 Jan, 2025 5 commits
- feat: refactor sgl-kernel and use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#3130) · 9286740e
  yinfan98 authored Jan 26, 2025
```
Co-authored-by: yinfan.1024 <yinfan.1024@bytedance.com>
Co-authored-by: yinfan98 <1106110035@qq.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  9286740e
- update installation doc for sgl-kernel (#3129) · 896c0744
  Yineng Zhang authored Jan 26, 2025
  
  896c0744
- chore: bump v0.0.2.post17 for sgl-kernel (#3125) · 14e754a8
  Yineng Zhang authored Jan 25, 2025
  
  14e754a8
- mirror fix for custom allreduce (#3124) · 98522149
  yizhang2077 authored Jan 25, 2025
  
  98522149
- support fp32 in sampling_scaling_penalties kernel (#3121) · 5d9d15e7
  Xiaoyu Zhang authored Jan 25, 2025
  
  5d9d15e7
24 Jan, 2025 6 commits
- Add workflow for sgl-kernel cu118 release (#3109) · a22f60a3
  Ke Bao authored Jan 24, 2025
  
  a22f60a3
- minor: update sgl-kernel setup (#3107) · 04f0b4cb
  Yineng Zhang authored Jan 24, 2025
  
  04f0b4cb
- Allow local cutlass directory to be used in sgl-kernel build (#3037) · 685a5738
  Trevor Morris authored Jan 24, 2025
  
  685a5738
- minor: sync flashinfer and add turbomind as 3rdparty (#3105) · 153b414e
  Yineng Zhang authored Jan 24, 2025
  
  153b414e
- Fix cu118 group gemm compile issue (#3097) · 6619f48e
  Ke Bao authored Jan 24, 2025
  
  6619f48e
- Add shapes for int8 gemm benchmark (#3093) · 7bad7e75
  Ke Bao authored Jan 24, 2025
  
  7bad7e75
23 Jan, 2025 3 commits
- chore: bump sgl-kernel 0.0.2.post16 (#3087) · 54bac8af
  Yineng Zhang authored Jan 24, 2025
  
  54bac8af
- feat: integrate sampling kernels into sgl-kernel (#3086) · 5de4051b
  Yineng Zhang authored Jan 24, 2025
```
Co-authored-by: Zihao Ye <expye@outlook.com>
```
  5de4051b
- [hotfix] fix test_sampling_scaling_penalties.py ci test (#3084) · e0cd65c2
  Xiaoyu Zhang authored Jan 24, 2025
  
  e0cd65c2