Commits · e9f8e423189070d3b223457303ddce8ccb9ce1e7 · change / sglang

25 Mar, 2025 1 commit
- Support FP4 gemm (1/2) (#3899) · e9f8e423
  Trevor Morris authored Mar 24, 2025
  
  e9f8e423
24 Mar, 2025 1 commit
- [Quant Kernel] refactored per token group quant fp8 to support int8 up-to 2x faster (#4396) · 65c24c28
  Chunan Zeng authored Mar 23, 2025
  
  65c24c28
16 Mar, 2025 3 commits
- Revert "feat: Add FlashMLA submodule (#4449)" (#4470) · 9971dc22
  Yineng Zhang authored Mar 16, 2025
  
  9971dc22
- Add greedy verification kernel (#4383) · 52a34d74
  Ying Sheng authored Mar 16, 2025
  
  52a34d74
- feat: Add FlashMLA submodule (#4449) · 81f431ed
  Shi Shuai authored Mar 16, 2025
```
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
```
  81f431ed
14 Mar, 2025 1 commit
- Add moe topk softmax templated from vllm (#4302) · 61e4433c
  Qingquan Song authored Mar 14, 2025
  
  61e4433c
13 Mar, 2025 1 commit
- fix accuracy issue (#4376) · 2937387a
  Yineng Zhang authored Mar 13, 2025
  
  2937387a
12 Mar, 2025 2 commits
- Support Blackwell Block Scale FP8 Gemm (#4278) · 7c866711
  Elfie Guo authored Mar 12, 2025
  
  7c866711
- Add awq dequantize kernel to sgl with 1x to 3x speedup (#4104) · 07f94463
  Rex authored Mar 12, 2025
  
  07f94463
10 Mar, 2025 4 commits
- DeepGemm integrate to sgl-kernel (#4165) · c553e160
  laixin authored Mar 10, 2025
```
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
Co-authored-by: yinfan98 <1106310035@qq.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  c553e160
- Move activation.cu to sgl-kernel/elementwise (#4250) · 7c0541b3
  Lianmin Zheng authored Mar 09, 2025
  
  7c0541b3
- Minor style fix for sgl-kernel (#4243) · 730d084f
  Lianmin Zheng authored Mar 09, 2025
  
  730d084f
- Move rope and bmm into sgl-kernel (#4241) · eb06dbcb
  Lianmin Zheng authored Mar 09, 2025
  
  eb06dbcb
09 Mar, 2025 2 commits
- update sgl-kernel 3rdparty (#4228) · df84ab2a
  Yineng Zhang authored Mar 09, 2025
  
  df84ab2a
- Rename files in sgl kernel to avoid nested folder structure (#4213) · 8abf74e3
  Lianmin Zheng authored Mar 08, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  8abf74e3
07 Mar, 2025 2 commits
- Add sgl_per_token_quant_fp8 (#4089) · 63ee26d1
  Stefan He authored Mar 06, 2025
  
  63ee26d1
- [quant kernel] sgl-kernel support per_tensor_quant fp8 (#3786) · ad55f171
  Xiaoyu Zhang authored Mar 07, 2025
  
  ad55f171
05 Mar, 2025 1 commit
- [Minor] more code cleanup (#4077) · e074d84e
  Lianmin Zheng authored Mar 04, 2025
  
  e074d84e
04 Mar, 2025 1 commit
- remove unused max_jobs (#3607) · 926f8efc
  Liu Jinjie authored Mar 04, 2025
```
Signed-off-by: Jinjie Liu <jinjie.liu@usc.edu>
```
  926f8efc
03 Mar, 2025 2 commits
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
- Reorganize c++ source files in sgl-kernel with multiple folders (#4025) · 6b45a21d
  Lianmin Zheng authored Mar 03, 2025
  
  6b45a21d
18 Feb, 2025 1 commit
- [Feature] Apply Cublas Grouped Gemm kernel (#3629) · 67fc595b
  Baizhou Zhang authored Feb 17, 2025
  
  67fc595b
12 Feb, 2025 1 commit
- support blockwise fp8 matmul kernel (#3267) · 640363ad
  yizhang2077 authored Feb 13, 2025
  
  640363ad
11 Feb, 2025 1 commit
- optimize per token group quant fp8 (#3490) · bb418ced
  Xiaoyu Zhang authored Feb 11, 2025
  
  bb418ced
09 Feb, 2025 1 commit
- fix cu118 link issue (#3421) · 29daf498
  Yineng Zhang authored Feb 09, 2025
  
  29daf498
07 Feb, 2025 1 commit
- support speculative decoding kernel in sgl-kernel (#3373) · f9905d59
  Yineng Zhang authored Feb 07, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  f9905d59
03 Feb, 2025 1 commit
- add copyright for sgl-kernel (#3270) · 00fa7d04
  Yineng Zhang authored Feb 03, 2025
  
  00fa7d04
31 Jan, 2025 1 commit
- revert the MoE dependence (#3230) · 3ee62235
  Yineng Zhang authored Jan 31, 2025
  
  3ee62235
30 Jan, 2025 2 commits
- add tensorrt_llm common and cutlass_extensions as 3rdparty (#3216) · 222ce6f1
  Yineng Zhang authored Jan 30, 2025
```
Co-authored-by: BBuf <35585791+BBuf@users.noreply.github.com>
```
  222ce6f1
- update setup for sgl-kernel (#3214) · 468d23cf
  Yineng Zhang authored Jan 30, 2025
  
  468d23cf
27 Jan, 2025 3 commits
- cleanup sgl-kernel kernels (#3175) · 827aa873
  Yineng Zhang authored Jan 27, 2025
  
  827aa873
- Improve weight loading and code style (#3174) · 53cef815
  Lianmin Zheng authored Jan 27, 2025
  
  53cef815
- [kernel] Integrate flashinfer's rope with higher precision and better perf (#3134) · fb11a439
  Byron Hsu authored Jan 26, 2025
  
  fb11a439
26 Jan, 2025 4 commits
- use self-hosted to build sgl-kernel (#3154) · f265d15b
  Yineng Zhang authored Jan 26, 2025
  
  f265d15b
- fix link in README (#3153) · 02431b9a
  Yineng Zhang authored Jan 26, 2025
  
  02431b9a
- support w8a8 fp8 kernel with CUTLASS (#3047) · 82392da8
  HandH1998 authored Jan 26, 2025
```
Co-authored-by: yych0745 <1398089567@qq.com>
```
  82392da8
- minor: cleanup sgl-kernel (#3143) · 95f789ad
  Yineng Zhang authored Jan 26, 2025
  
  95f789ad
25 Jan, 2025 1 commit

feat: refactor sgl-kernel and use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#3130) · 9286740e

yinfan98 authored Jan 26, 2025


Co-authored-by: yinfan.1024 <yinfan.1024@bytedance.com>
Co-authored-by: yinfan98 <1106110035@qq.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

9286740e

24 Jan, 2025 2 commits
- minor: update sgl-kernel setup (#3107) · 04f0b4cb
  Yineng Zhang authored Jan 24, 2025
  
  04f0b4cb
- Allow local cutlass directory to be used in sgl-kernel build (#3037) · 685a5738
  Trevor Morris authored Jan 24, 2025
  
  685a5738