Commits · df84ab2a5b87f4e8490049beb74fab6e67bbe3df · change / sglang · GitLab

09 Mar, 2025 4 commits
- update sgl-kernel 3rdparty (#4228) · df84ab2a
  Yineng Zhang authored Mar 09, 2025
  
  df84ab2a
- chore: bump v0.0.4 for sgl-kernel (#4223) · 5c7dd14b
  Yineng Zhang authored Mar 08, 2025
  
  5c7dd14b
- Rename files in sgl kernel to avoid nested folder structure (#4213) · 8abf74e3
  Lianmin Zheng authored Mar 08, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  8abf74e3
- revert pr 3628 to pass test_mla ci (#4219) · 79a321af
  Xiaoyu Zhang authored Mar 09, 2025
  
  79a321af
08 Mar, 2025 6 commits
- refine quant kernel code style (#4211) · b3251e9f
  Xiaoyu Zhang authored Mar 08, 2025
  
  b3251e9f
- Use clang format 18 in pr-test-sgl-kernel.yml (#4203) · 8d323e95
  Lianmin Zheng authored Mar 08, 2025
  
  8d323e95
- Revert "Minor improvement to per_tensor_quant_fp8 (#4197)" (#4198) · 96d0e37f
  Yineng Zhang authored Mar 07, 2025
  
  96d0e37f
- Minor improvement to per_tensor_quant_fp8 (#4197) · 90bb2be2
  Rex authored Mar 07, 2025
  
  90bb2be2
- Remove the vllm dependency from the moe_align function (#4164) · b93ef5e5
  lukec authored Mar 08, 2025
```
Co-authored-by: Hongbosherlock <hongbosherlock@gmail.com>
```
  b93ef5e5
- New clang format for sgl kernel (#4194) · d052f4c8
  Lianmin Zheng authored Mar 07, 2025
  
  d052f4c8
07 Mar, 2025 8 commits
- Revert "ROCm: Flex Attention Enablement with custom backends (#4178)" (#4186) · eb61f5c9
  Yineng Zhang authored Mar 07, 2025
  
  eb61f5c9
- ROCm: Flex Attention Enablement with custom backends (#4178) · 0beea450
  HAI authored Mar 07, 2025
```
Co-authored-by: linsun12 <linsun12@amd.com>
```
  0beea450
- chore: bump v0.0.3.post7 for sgl-kernel (#4176) · 96263f27
  Yineng Zhang authored Mar 07, 2025
  
  96263f27
- Put utils in ifndef USE_ROCM to fix CI (#4167) (#4168) · 94a2b9d3
  Yineng Zhang authored Mar 07, 2025
```
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
```
  94a2b9d3
- Remove non-existent AMD header include (#4166) · 3c3eb374
  Stefan He authored Mar 06, 2025
  
  3c3eb374
- [Refactor] Reducing code duplication across FP8 CUDA quantization kernels (#4163) · 95085d65
  Stefan He authored Mar 06, 2025
  
  95085d65
- Add sgl_per_token_quant_fp8 (#4089) · 63ee26d1
  Stefan He authored Mar 06, 2025
  
  63ee26d1
- [quant kernel] sgl-kernel support per_tensor_quant fp8 (#3786) · ad55f171
  Xiaoyu Zhang authored Mar 07, 2025
  
  ad55f171
06 Mar, 2025 1 commit
- remove unused max_jobs in setup_rocm.py (#4126) · 0804dd11
  Liu Jinjie authored Mar 06, 2025
```
Signed-off-by: Jinjie Liu <jinjie.liu@usc.edu>
```
  0804dd11
05 Mar, 2025 1 commit
- [Minor] more code cleanup (#4077) · e074d84e
  Lianmin Zheng authored Mar 04, 2025
  
  e074d84e
04 Mar, 2025 1 commit
- remove unused max_jobs (#3607) · 926f8efc
  Liu Jinjie authored Mar 04, 2025
```
Signed-off-by: Jinjie Liu <jinjie.liu@usc.edu>
```
  926f8efc
03 Mar, 2025 5 commits
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
- Reorganize python source files in sgl-kernel with multiple files (#4027) · 110e0066
  Lianmin Zheng authored Mar 03, 2025
  
  110e0066
- Reorganize c++ source files in sgl-kernel with multiple folders (#4025) · 6b45a21d
  Lianmin Zheng authored Mar 03, 2025
  
  6b45a21d
- Improve code styles (#4021) · 66301e12
  Lianmin Zheng authored Mar 03, 2025
  
  66301e12
- Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727
  Lianmin Zheng authored Mar 03, 2025
```
Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>
```
  ac238727
02 Mar, 2025 1 commit
- Enable custom AR for AMD GPUs and maintain it in sgl-kernel (#3406) · 9cf40772
  Hubert Lu authored Mar 02, 2025
  
  9cf40772
01 Mar, 2025 2 commits
- Revert "[MOE] enable efficient moe_alignment multi-blocks execution (3x~6x)" (#3982) · 18bb216c
  Chayenne authored Feb 28, 2025
  
  18bb216c
- Update cutlass dependency (#3966) · 9e74ee91
  Elfie Guo authored Feb 28, 2025
  
  9e74ee91
28 Feb, 2025 1 commit
- [MOE] enable efficient moe_alignment multi-blocks execution (3x~6x) (#3613) · 1c96fa86
  yiakwy-xpu-ml-framework-team authored Feb 28, 2025
  
  1c96fa86
19 Feb, 2025 1 commit
- use warp shuffle style reduce and flashinfer vectorize (#3628) · 55a7ec38
  Xiaoyu Zhang authored Feb 19, 2025
  
  55a7ec38
18 Feb, 2025 1 commit
- [Feature] Apply Cublas Grouped Gemm kernel (#3629) · 67fc595b
  Baizhou Zhang authored Feb 17, 2025
  
  67fc595b
14 Feb, 2025 2 commits
- fix sgl-kernel codestyle (#3563) · 3efbdf68
  Xiaoyu Zhang authored Feb 14, 2025
  
  3efbdf68
- chore: bump 0.0.3.post6 sgl-kernel (#3555) · e0821425
  Yineng Zhang authored Feb 14, 2025
  
  e0821425
13 Feb, 2025 1 commit
- fix moe_align_kernel shm init not sync bug (#3534) · f076328b
  Xiaoyu Zhang authored Feb 13, 2025
  
  f076328b
12 Feb, 2025 3 commits
- chore: bump 0.0.3.post5 sgl-kernel (#3530) · 4430c0a5
  Yineng Zhang authored Feb 13, 2025
  
  4430c0a5
- support blockwise fp8 matmul kernel (#3267) · 640363ad
  yizhang2077 authored Feb 13, 2025
  
  640363ad
- chore: bump 0.0.3.post4 sgl-kernel (#3523) · b96e92e6
  Yineng Zhang authored Feb 12, 2025
  
  b96e92e6
11 Feb, 2025 1 commit
- optimize per token group quant fp8 (#3490) · bb418ced
  Xiaoyu Zhang authored Feb 11, 2025
  
  bb418ced
09 Feb, 2025 1 commit
- chore: bump sgl-kernel v0.0.3.post3 (#3440) · 6239d0b2
  Yineng Zhang authored Feb 10, 2025
  
  6239d0b2