Commits · 07ab4d4a2df2ca28cfa82197e6a692a0f69c1d02 · change / sglang · GitLab

14 Feb, 2025 2 commits
- fix sgl-kernel codestyle (#3563) · 3efbdf68
  Xiaoyu Zhang authored Feb 14, 2025
  
  3efbdf68
- chore: bump 0.0.3.post6 sgl-kernel (#3555) · e0821425
  Yineng Zhang authored Feb 14, 2025
  
  e0821425
13 Feb, 2025 1 commit
- fix moe_align_kernel shm init not sync bug (#3534) · f076328b
  Xiaoyu Zhang authored Feb 13, 2025
  
  f076328b
12 Feb, 2025 3 commits
- chore: bump 0.0.3.post5 sgl-kernel (#3530) · 4430c0a5
  Yineng Zhang authored Feb 13, 2025
  
  4430c0a5
- support blockwise fp8 matmul kernel (#3267) · 640363ad
  yizhang2077 authored Feb 13, 2025
  
  640363ad
- chore: bump 0.0.3.post4 sgl-kernel (#3523) · b96e92e6
  Yineng Zhang authored Feb 12, 2025
  
  b96e92e6
11 Feb, 2025 1 commit
- optimize per token group quant fp8 (#3490) · bb418ced
  Xiaoyu Zhang authored Feb 11, 2025
  
  bb418ced
09 Feb, 2025 3 commits
- chore: bump sgl-kernel v0.0.3.post3 (#3440) · 6239d0b2
  Yineng Zhang authored Feb 10, 2025
  
  6239d0b2
- support version in sgl-kernel (#3439) · 4cfd3add
  Yineng Zhang authored Feb 10, 2025
  
  4cfd3add
- fix cu118 link issue (#3421) · 29daf498
  Yineng Zhang authored Feb 09, 2025
  
  29daf498
07 Feb, 2025 2 commits
- support speculative decoding kernel in sgl-kernel (#3373) · f9905d59
  Yineng Zhang authored Feb 07, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  f9905d59
- fix undefined symbol cudaGetDriverEntryPointByVersion (#3372) · 45c87e08
  Yineng Zhang authored Feb 07, 2025
  
  45c87e08
06 Feb, 2025 3 commits
- optimize moe_align_kernel cuda (#3347) · cdae77b0
  Xiaoyu Zhang authored Feb 07, 2025
  
  cdae77b0
- fix sgl-kernel build failure on AMD (#3352) · adeee152
  Yineng Zhang authored Feb 07, 2025
  
  adeee152
- clean moe align block kernel code and add acc test (#3332) · ad349985
  Xiaoyu Zhang authored Feb 06, 2025
  
  ad349985
04 Feb, 2025 1 commit
- ROCm: sgl-kernel enablement starting with sgl_moe_align_block (#3287) · 2c1a695f
  HAI authored Feb 04, 2025
  
  2c1a695f
03 Feb, 2025 1 commit
- add copyright for sgl-kernel (#3270) · 00fa7d04
  Yineng Zhang authored Feb 03, 2025
  
  00fa7d04
31 Jan, 2025 2 commits
- update cutlass dependency (#3240) · 7876279e
  Yineng Zhang authored Feb 01, 2025
  
  7876279e
- revert the MoE dependence (#3230) · 3ee62235
  Yineng Zhang authored Jan 31, 2025
  
  3ee62235
30 Jan, 2025 5 commits
- keep the parts needed for moe_kernels (#3218) · 9602c2aa
  Yineng Zhang authored Jan 31, 2025
  
  9602c2aa
- add tensorrt_llm moe_gemm as 3rdparty (#3217) · e81d7f11
  Yineng Zhang authored Jan 30, 2025
  
  e81d7f11
- add tensorrt_llm common and cutlass_extensions as 3rdparty (#3216) · 222ce6f1
  Yineng Zhang authored Jan 30, 2025
```
Co-authored-by: BBuf <35585791+BBuf@users.noreply.github.com>
```
  222ce6f1
- update setup for sgl-kernel (#3214) · 468d23cf
  Yineng Zhang authored Jan 30, 2025
  
  468d23cf
- update 3rdparty and rms norm for sgl-kernel (#3213) · c38b5fb4
  Yineng Zhang authored Jan 30, 2025
  
  c38b5fb4
28 Jan, 2025 1 commit
- clean up useless file (#3192) · 81262c7b
  Xiaoyu Zhang authored Jan 28, 2025
  
  81262c7b
27 Jan, 2025 6 commits
- chore: bump 0.0.3 for sgl-kernel (#3178) · 8a96f749
  Yineng Zhang authored Jan 27, 2025
```
Co-authored-by: ispobock <ispobaoke@hotmail.com>
Co-authored-by: BBuf <35585791+BBuf@users.noreply.github.com>
Co-authored-by: HandH1998 <007aabbcc411@gmail.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: ByronHsu <byronhsu1230@gmail.com>
```
  8a96f749
- cleanup sgl-kernel kernels (#3175) · 827aa873
  Yineng Zhang authored Jan 27, 2025
  
  827aa873
- Improve weight loading and code style (#3174) · 53cef815
  Lianmin Zheng authored Jan 27, 2025
  
  53cef815
- [kernel] Fix position ids in rope (#3173) · 514f37c3
  Byron Hsu authored Jan 27, 2025
  
  514f37c3
- Bump sgl kernel to 0.0.2.post19 (#3167) · 741fccd7
  Byron Hsu authored Jan 26, 2025
  
  741fccd7
- [kernel] Integrate flashinfer's rope with higher precision and better perf (#3134) · fb11a439
  Byron Hsu authored Jan 26, 2025
  
  fb11a439
26 Jan, 2025 5 commits
- use self-hosted to build sgl-kernel (#3154) · f265d15b
  Yineng Zhang authored Jan 26, 2025
  
  f265d15b
- fix link in README (#3153) · 02431b9a
  Yineng Zhang authored Jan 26, 2025
  
  02431b9a
- chore: bump 0.0.2.post18 for sgl-kernel (#3149) · 318260c0
  Yineng Zhang authored Jan 26, 2025
  
  318260c0
- support w8a8 fp8 kernel with CUTLASS (#3047) · 82392da8
  HandH1998 authored Jan 26, 2025
```
Co-authored-by: yych0745 <1398089567@qq.com>
```
  82392da8
- minor: cleanup sgl-kernel (#3143) · 95f789ad
  Yineng Zhang authored Jan 26, 2025
  
  95f789ad
25 Jan, 2025 4 commits
- feat: refactor sgl-kernel and use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#3130) · 9286740e
  yinfan98 authored Jan 26, 2025
```
Co-authored-by: yinfan.1024 <yinfan.1024@bytedance.com>
Co-authored-by: yinfan98 <1106110035@qq.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  9286740e
- update installation doc for sgl-kernel (#3129) · 896c0744
  Yineng Zhang authored Jan 26, 2025
  
  896c0744
- chore: bump v0.0.2.post17 for sgl-kernel (#3125) · 14e754a8
  Yineng Zhang authored Jan 25, 2025
  
  14e754a8
- mirror fix for custom allreduce (#3124) · 98522149
  yizhang2077 authored Jan 25, 2025
  
  98522149