Commits · 95085d65e9d2f2ee1da3e6fd192d838b3636f85d · change / sglang · GitLab

07 Mar, 2025 3 commits
- [Refactor] Reducing code duplication across FP8 CUDA quantization kernels (#4163) · 95085d65
  Stefan He authored Mar 06, 2025
  
  95085d65
- Add sgl_per_token_quant_fp8 (#4089) · 63ee26d1
  Stefan He authored Mar 06, 2025
  
  63ee26d1
- [quant kernel] sgl-kernel support per_tensor_quant fp8 (#3786) · ad55f171
  Xiaoyu Zhang authored Mar 07, 2025
  
  ad55f171
03 Mar, 2025 5 commits
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
- Reorganize python source files in sgl-kernel with multiple files (#4027) · 110e0066
  Lianmin Zheng authored Mar 03, 2025
  
  110e0066
- Reorganize c++ source files in sgl-kernel with multiple folders (#4025) · 6b45a21d
  Lianmin Zheng authored Mar 03, 2025
  
  6b45a21d
- Improve code styles (#4021) · 66301e12
  Lianmin Zheng authored Mar 03, 2025
  
  66301e12
- Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727
  Lianmin Zheng authored Mar 03, 2025
```
Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>
```
  ac238727
02 Mar, 2025 1 commit
- Enable custom AR for AMD GPUs and maintain it in sgl-kernel (#3406) · 9cf40772
  Hubert Lu authored Mar 02, 2025
  
  9cf40772
01 Mar, 2025 1 commit
- Revert "[MOE] enable efficient moe_alignment multi-blocks execution (3x~6x)" (#3982) · 18bb216c
  Chayenne authored Feb 28, 2025
  
  18bb216c
28 Feb, 2025 1 commit
- [MOE] enable efficient moe_alignment multi-blocks execution (3x~6x) (#3613) · 1c96fa86
  yiakwy-xpu-ml-framework-team authored Feb 28, 2025
  
  1c96fa86
19 Feb, 2025 1 commit
- use warp shuffle style reduce and flashinfer vectorize (#3628) · 55a7ec38
  Xiaoyu Zhang authored Feb 19, 2025
  
  55a7ec38
18 Feb, 2025 1 commit
- [Feature] Apply Cublas Grouped Gemm kernel (#3629) · 67fc595b
  Baizhou Zhang authored Feb 17, 2025
  
  67fc595b
14 Feb, 2025 2 commits
- fix sgl-kernel codestyle (#3563) · 3efbdf68
  Xiaoyu Zhang authored Feb 14, 2025
  
  3efbdf68
- chore: bump 0.0.3.post6 sgl-kernel (#3555) · e0821425
  Yineng Zhang authored Feb 14, 2025
  
  e0821425
13 Feb, 2025 1 commit
- fix moe_align_kernel shm init not sync bug (#3534) · f076328b
  Xiaoyu Zhang authored Feb 13, 2025
  
  f076328b
12 Feb, 2025 3 commits
- chore: bump 0.0.3.post5 sgl-kernel (#3530) · 4430c0a5
  Yineng Zhang authored Feb 13, 2025
  
  4430c0a5
- support blockwise fp8 matmul kernel (#3267) · 640363ad
  yizhang2077 authored Feb 13, 2025
  
  640363ad
- chore: bump 0.0.3.post4 sgl-kernel (#3523) · b96e92e6
  Yineng Zhang authored Feb 12, 2025
  
  b96e92e6
11 Feb, 2025 1 commit
- optimize per token group quant fp8 (#3490) · bb418ced
  Xiaoyu Zhang authored Feb 11, 2025
  
  bb418ced
09 Feb, 2025 2 commits
- chore: bump sgl-kernel v0.0.3.post3 (#3440) · 6239d0b2
  Yineng Zhang authored Feb 10, 2025
  
  6239d0b2
- support version in sgl-kernel (#3439) · 4cfd3add
  Yineng Zhang authored Feb 10, 2025
  
  4cfd3add
07 Feb, 2025 2 commits
- support speculative decoding kernel in sgl-kernel (#3373) · f9905d59
  Yineng Zhang authored Feb 07, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  f9905d59
- fix undefined symbol cudaGetDriverEntryPointByVersion (#3372) · 45c87e08
  Yineng Zhang authored Feb 07, 2025
  
  45c87e08
06 Feb, 2025 3 commits
- optimize moe_align_kernel cuda (#3347) · cdae77b0
  Xiaoyu Zhang authored Feb 07, 2025
  
  cdae77b0
- fix sgl-kernel build failure on AMD (#3352) · adeee152
  Yineng Zhang authored Feb 07, 2025
  
  adeee152
- clean moe align block kernel code and add acc test (#3332) · ad349985
  Xiaoyu Zhang authored Feb 06, 2025
  
  ad349985
04 Feb, 2025 1 commit
- ROCm: sgl-kernel enablement starting with sgl_moe_align_block (#3287) · 2c1a695f
  HAI authored Feb 04, 2025
  
  2c1a695f
03 Feb, 2025 1 commit
- add copyright for sgl-kernel (#3270) · 00fa7d04
  Yineng Zhang authored Feb 03, 2025
  
  00fa7d04
30 Jan, 2025 1 commit
- update 3rdparty and rms norm for sgl-kernel (#3213) · c38b5fb4
  Yineng Zhang authored Jan 30, 2025
  
  c38b5fb4
27 Jan, 2025 4 commits
- chore: bump 0.0.3 for sgl-kernel (#3178) · 8a96f749
  Yineng Zhang authored Jan 27, 2025
```
Co-authored-by: ispobock <ispobaoke@hotmail.com>
Co-authored-by: BBuf <35585791+BBuf@users.noreply.github.com>
Co-authored-by: HandH1998 <007aabbcc411@gmail.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: ByronHsu <byronhsu1230@gmail.com>
```
  8a96f749
- cleanup sgl-kernel kernels (#3175) · 827aa873
  Yineng Zhang authored Jan 27, 2025
  
  827aa873
- [kernel] Fix position ids in rope (#3173) · 514f37c3
  Byron Hsu authored Jan 27, 2025
  
  514f37c3
- [kernel] Integrate flashinfer's rope with higher precision and better perf (#3134) · fb11a439
  Byron Hsu authored Jan 26, 2025
  
  fb11a439
26 Jan, 2025 2 commits
- support w8a8 fp8 kernel with CUTLASS (#3047) · 82392da8
  HandH1998 authored Jan 26, 2025
```
Co-authored-by: yych0745 <1398089567@qq.com>
```
  82392da8
- minor: cleanup sgl-kernel (#3143) · 95f789ad
  Yineng Zhang authored Jan 26, 2025
  
  95f789ad
25 Jan, 2025 3 commits
- feat: refactor sgl-kernel and use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#3130) · 9286740e
  yinfan98 authored Jan 26, 2025
```
Co-authored-by: yinfan.1024 <yinfan.1024@bytedance.com>
Co-authored-by: yinfan98 <1106110035@qq.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  9286740e
- mirror fix for custom allreduce (#3124) · 98522149
  yizhang2077 authored Jan 25, 2025
  
  98522149
- support fp32 in sampling_scaling_penalties kernel (#3121) · 5d9d15e7
  Xiaoyu Zhang authored Jan 25, 2025
  
  5d9d15e7
24 Jan, 2025 1 commit
- minor: update sgl-kernel setup (#3107) · 04f0b4cb
  Yineng Zhang authored Jan 24, 2025
  
  04f0b4cb