Commits · 935cda944b82d4828e9efb6606cd449afa4cd71c · change / sglang · GitLab

03 Mar, 2025 5 commits
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
- Reorganize python source files in sgl-kernel with multiple files (#4027) · 110e0066
  Lianmin Zheng authored Mar 03, 2025
  
  110e0066
- Reorganize c++ source files in sgl-kernel with multiple folders (#4025) · 6b45a21d
  Lianmin Zheng authored Mar 03, 2025
  
  6b45a21d
- Improve code styles (#4021) · 66301e12
  Lianmin Zheng authored Mar 03, 2025
  
  66301e12
- Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727
  Lianmin Zheng authored Mar 03, 2025
```
Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>
```
  ac238727
02 Mar, 2025 1 commit
- Enable custom AR for AMD GPUs and maintain it in sgl-kernel (#3406) · 9cf40772
  Hubert Lu authored Mar 02, 2025
  
  9cf40772
01 Mar, 2025 2 commits
- Revert "[MOE] enable efficient moe_alignment multi-blocks execution (3x~6x)" (#3982) · 18bb216c
  Chayenne authored Feb 28, 2025
  
  18bb216c
- Update cutlass dependency (#3966) · 9e74ee91
  Elfie Guo authored Feb 28, 2025
  
  9e74ee91
28 Feb, 2025 1 commit
- [MOE] enable efficient moe_alignment multi-blocks execution (3x~6x) (#3613) · 1c96fa86
  yiakwy-xpu-ml-framework-team authored Feb 28, 2025
  
  1c96fa86
19 Feb, 2025 1 commit
- use warp shuffle style reduce and flashinfer vectorize (#3628) · 55a7ec38
  Xiaoyu Zhang authored Feb 19, 2025
  
  55a7ec38
18 Feb, 2025 1 commit
- [Feature] Apply Cublas Grouped Gemm kernel (#3629) · 67fc595b
  Baizhou Zhang authored Feb 17, 2025
  
  67fc595b
14 Feb, 2025 2 commits
- fix sgl-kernel codestyle (#3563) · 3efbdf68
  Xiaoyu Zhang authored Feb 14, 2025
  
  3efbdf68
- chore: bump 0.0.3.post6 sgl-kernel (#3555) · e0821425
  Yineng Zhang authored Feb 14, 2025
  
  e0821425
13 Feb, 2025 1 commit
- fix moe_align_kernel shm init not sync bug (#3534) · f076328b
  Xiaoyu Zhang authored Feb 13, 2025
  
  f076328b
12 Feb, 2025 3 commits
- chore: bump 0.0.3.post5 sgl-kernel (#3530) · 4430c0a5
  Yineng Zhang authored Feb 13, 2025
  
  4430c0a5
- support blockwise fp8 matmul kernel (#3267) · 640363ad
  yizhang2077 authored Feb 13, 2025
  
  640363ad
- chore: bump 0.0.3.post4 sgl-kernel (#3523) · b96e92e6
  Yineng Zhang authored Feb 12, 2025
  
  b96e92e6
11 Feb, 2025 1 commit
- optimize per token group quant fp8 (#3490) · bb418ced
  Xiaoyu Zhang authored Feb 11, 2025
  
  bb418ced
09 Feb, 2025 3 commits
- chore: bump sgl-kernel v0.0.3.post3 (#3440) · 6239d0b2
  Yineng Zhang authored Feb 10, 2025
  
  6239d0b2
- support version in sgl-kernel (#3439) · 4cfd3add
  Yineng Zhang authored Feb 10, 2025
  
  4cfd3add
- fix cu118 link issue (#3421) · 29daf498
  Yineng Zhang authored Feb 09, 2025
  
  29daf498
07 Feb, 2025 2 commits
- support speculative decoding kernel in sgl-kernel (#3373) · f9905d59
  Yineng Zhang authored Feb 07, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  f9905d59
- fix undefined symbol cudaGetDriverEntryPointByVersion (#3372) · 45c87e08
  Yineng Zhang authored Feb 07, 2025
  
  45c87e08
06 Feb, 2025 3 commits
- optimize moe_align_kernel cuda (#3347) · cdae77b0
  Xiaoyu Zhang authored Feb 07, 2025
  
  cdae77b0
- fix sgl-kernel build failure on AMD (#3352) · adeee152
  Yineng Zhang authored Feb 07, 2025
  
  adeee152
- clean moe align block kernel code and add acc test (#3332) · ad349985
  Xiaoyu Zhang authored Feb 06, 2025
  
  ad349985
04 Feb, 2025 1 commit
- ROCm: sgl-kernel enablement starting with sgl_moe_align_block (#3287) · 2c1a695f
  HAI authored Feb 04, 2025
  
  2c1a695f
03 Feb, 2025 1 commit
- add copyright for sgl-kernel (#3270) · 00fa7d04
  Yineng Zhang authored Feb 03, 2025
  
  00fa7d04
31 Jan, 2025 2 commits
- update cutlass dependency (#3240) · 7876279e
  Yineng Zhang authored Feb 01, 2025
  
  7876279e
- revert the MoE dependence (#3230) · 3ee62235
  Yineng Zhang authored Jan 31, 2025
  
  3ee62235
30 Jan, 2025 5 commits
- keep the parts needed for moe_kernels (#3218) · 9602c2aa
  Yineng Zhang authored Jan 31, 2025
  
  9602c2aa
- add tensorrt_llm moe_gemm as 3rdparty (#3217) · e81d7f11
  Yineng Zhang authored Jan 30, 2025
  
  e81d7f11
- add tensorrt_llm common and cutlass_extensions as 3rdparty (#3216) · 222ce6f1
  Yineng Zhang authored Jan 30, 2025
```
Co-authored-by: BBuf <35585791+BBuf@users.noreply.github.com>
```
  222ce6f1
- update setup for sgl-kernel (#3214) · 468d23cf
  Yineng Zhang authored Jan 30, 2025
  
  468d23cf
- update 3rdparty and rms norm for sgl-kernel (#3213) · c38b5fb4
  Yineng Zhang authored Jan 30, 2025
  
  c38b5fb4
28 Jan, 2025 1 commit
- clean up useless file (#3192) · 81262c7b
  Xiaoyu Zhang authored Jan 28, 2025
  
  81262c7b
27 Jan, 2025 4 commits
- chore: bump 0.0.3 for sgl-kernel (#3178) · 8a96f749
  Yineng Zhang authored Jan 27, 2025
```
Co-authored-by: ispobock <ispobaoke@hotmail.com>
Co-authored-by: BBuf <35585791+BBuf@users.noreply.github.com>
Co-authored-by: HandH1998 <007aabbcc411@gmail.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: ByronHsu <byronhsu1230@gmail.com>
```
  8a96f749
- cleanup sgl-kernel kernels (#3175) · 827aa873
  Yineng Zhang authored Jan 27, 2025
  
  827aa873
- Improve weight loading and code style (#3174) · 53cef815
  Lianmin Zheng authored Jan 27, 2025
  
  53cef815
- [kernel] Fix position ids in rope (#3173) · 514f37c3
  Byron Hsu authored Jan 27, 2025
  
  514f37c3