Commits · 6e7239f91270bf3893cc76bf4e35a0720a6f37e8 · change / sglang · GitLab

12 Mar, 2025 5 commits
- release 0.0.4.post3 sgl-kernel (#4331) · 6e7239f9
  Yineng Zhang authored Mar 12, 2025
  
  6e7239f9
- fix awq_dequantize (#4333) · 0a3960f2
  Yineng Zhang authored Mar 12, 2025
  
  0a3960f2
- Add awq dequantize kernel to sgl with 1x to 3x speedup (#4104) · 07f94463
  Rex authored Mar 12, 2025
  
  07f94463
- Remove vllm ops scaled fp8 quant and accelerate per token quant by 20-28% (#4215) · e0917e6b
  Stefan He authored Mar 12, 2025
```
Co-authored-by: Stefan He <bhe@linkedin.com>
```
  e0917e6b
- refine sgl_moe_align_block_size_benchmark (#4327) · 7130a7ce
  Xiaoyu Zhang authored Mar 12, 2025
  
  7130a7ce
11 Mar, 2025 4 commits
- [AMD] Fix rocm sgl-kernel missing modules error (#4311) · 690e1f23
  yigex authored Mar 12, 2025
```
Co-authored-by: yiakwy-xpu-ml-framework-team <leiwang2@amd.com>
```
  690e1f23
- bump sgl-kernel 0.0.4.post2 (#4288) · cd909455
  Yineng Zhang authored Mar 11, 2025
  
  cd909455
- update deepgemm (#4284) · bde24ab3
  Yineng Zhang authored Mar 10, 2025
  
  bde24ab3
- Uupdate cutalss dependency for its bug fix (#4277) · bf2eefc0
  Elfie Guo authored Mar 10, 2025
  
  bf2eefc0
10 Mar, 2025 9 commits
- add THIRDPARTYNOTICES for DeepGEMM (#4272) · 3dd4feae
  Yineng Zhang authored Mar 10, 2025
  
  3dd4feae
- Optimize rope in sgl kernel (#4267) · cf0ccd40
  Lianmin Zheng authored Mar 10, 2025
  
  cf0ccd40
- Release sgl-kernel v0.0.4.post1 (#4255) · 1a5023e0
  Lianmin Zheng authored Mar 10, 2025
  
  1a5023e0
- fix per_token_group_quant_fp8 illegal memory when num_groups % 16 != 0 (#4231) · 23308a90
  Xiaoyu Zhang authored Mar 10, 2025
  
  23308a90
- Simplify tests & Fix trtllm custom allreduce registration (#4252) · aa957102
  Lianmin Zheng authored Mar 10, 2025
  
  aa957102
- DeepGemm integrate to sgl-kernel (#4165) · c553e160
  laixin authored Mar 10, 2025
```
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
Co-authored-by: yinfan98 <1106310035@qq.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  c553e160
- Move activation.cu to sgl-kernel/elementwise (#4250) · 7c0541b3
  Lianmin Zheng authored Mar 09, 2025
  
  7c0541b3
- Minor style fix for sgl-kernel (#4243) · 730d084f
  Lianmin Zheng authored Mar 09, 2025
  
  730d084f
- Move rope and bmm into sgl-kernel (#4241) · eb06dbcb
  Lianmin Zheng authored Mar 09, 2025
  
  eb06dbcb
09 Mar, 2025 4 commits
- update sgl-kernel 3rdparty (#4228) · df84ab2a
  Yineng Zhang authored Mar 09, 2025
  
  df84ab2a
- chore: bump v0.0.4 for sgl-kernel (#4223) · 5c7dd14b
  Yineng Zhang authored Mar 08, 2025
  
  5c7dd14b
- Rename files in sgl kernel to avoid nested folder structure (#4213) · 8abf74e3
  Lianmin Zheng authored Mar 08, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  8abf74e3
- revert pr 3628 to pass test_mla ci (#4219) · 79a321af
  Xiaoyu Zhang authored Mar 09, 2025
  
  79a321af
08 Mar, 2025 6 commits
- refine quant kernel code style (#4211) · b3251e9f
  Xiaoyu Zhang authored Mar 08, 2025
  
  b3251e9f
- Use clang format 18 in pr-test-sgl-kernel.yml (#4203) · 8d323e95
  Lianmin Zheng authored Mar 08, 2025
  
  8d323e95
- Revert "Minor improvement to per_tensor_quant_fp8 (#4197)" (#4198) · 96d0e37f
  Yineng Zhang authored Mar 07, 2025
  
  96d0e37f
- Minor improvement to per_tensor_quant_fp8 (#4197) · 90bb2be2
  Rex authored Mar 07, 2025
  
  90bb2be2
- Remove the vllm dependency from the moe_align function (#4164) · b93ef5e5
  lukec authored Mar 08, 2025
```
Co-authored-by: Hongbosherlock <hongbosherlock@gmail.com>
```
  b93ef5e5
- New clang format for sgl kernel (#4194) · d052f4c8
  Lianmin Zheng authored Mar 07, 2025
  
  d052f4c8
07 Mar, 2025 8 commits
- Revert "ROCm: Flex Attention Enablement with custom backends (#4178)" (#4186) · eb61f5c9
  Yineng Zhang authored Mar 07, 2025
  
  eb61f5c9
- ROCm: Flex Attention Enablement with custom backends (#4178) · 0beea450
  HAI authored Mar 07, 2025
```
Co-authored-by: linsun12 <linsun12@amd.com>
```
  0beea450
- chore: bump v0.0.3.post7 for sgl-kernel (#4176) · 96263f27
  Yineng Zhang authored Mar 07, 2025
  
  96263f27
- Put utils in ifndef USE_ROCM to fix CI (#4167) (#4168) · 94a2b9d3
  Yineng Zhang authored Mar 07, 2025
```
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
```
  94a2b9d3
- Remove non-existent AMD header include (#4166) · 3c3eb374
  Stefan He authored Mar 06, 2025
  
  3c3eb374
- [Refactor] Reducing code duplication across FP8 CUDA quantization kernels (#4163) · 95085d65
  Stefan He authored Mar 06, 2025
  
  95085d65
- Add sgl_per_token_quant_fp8 (#4089) · 63ee26d1
  Stefan He authored Mar 06, 2025
  
  63ee26d1
- [quant kernel] sgl-kernel support per_tensor_quant fp8 (#3786) · ad55f171
  Xiaoyu Zhang authored Mar 07, 2025
  
  ad55f171
06 Mar, 2025 1 commit
- remove unused max_jobs in setup_rocm.py (#4126) · 0804dd11
  Liu Jinjie authored Mar 06, 2025
```
Signed-off-by: Jinjie Liu <jinjie.liu@usc.edu>
```
  0804dd11
05 Mar, 2025 1 commit
- [Minor] more code cleanup (#4077) · e074d84e
  Lianmin Zheng authored Mar 04, 2025
  
  e074d84e
04 Mar, 2025 1 commit
- remove unused max_jobs (#3607) · 926f8efc
  Liu Jinjie authored Mar 04, 2025
```
Signed-off-by: Jinjie Liu <jinjie.liu@usc.edu>
```
  926f8efc
03 Mar, 2025 1 commit
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94