Commits · 153b414e835ead40017b00b3049bfb657a7748fa · change / sglang · GitLab

24 Jan, 2025 3 commits
- minor: sync flashinfer and add turbomind as 3rdparty (#3105) · 153b414e
  Yineng Zhang authored Jan 24, 2025
  
  153b414e
- Fix cu118 group gemm compile issue (#3097) · 6619f48e
  Ke Bao authored Jan 24, 2025
  
  6619f48e
- Add shapes for int8 gemm benchmark (#3093) · 7bad7e75
  Ke Bao authored Jan 24, 2025
  
  7bad7e75
23 Jan, 2025 12 commits
- chore: bump sgl-kernel 0.0.2.post16 (#3087) · 54bac8af
  Yineng Zhang authored Jan 24, 2025
  
  54bac8af
- feat: integrate sampling kernels into sgl-kernel (#3086) · 5de4051b
  Yineng Zhang authored Jan 24, 2025
```
Co-authored-by: Zihao Ye <expye@outlook.com>
```
  5de4051b
- [hotfix] fix test_sampling_scaling_penalties.py ci test (#3084) · e0cd65c2
  Xiaoyu Zhang authored Jan 24, 2025
  
  e0cd65c2
- use flashinfer vec_dtypes in sgl_kernel (#3083) · f1b68618
  Xiaoyu Zhang authored Jan 23, 2025
  
  f1b68618
- sync flashinfer and update sgl-kernel tests (#3081) · 0da0989a
  Yineng Zhang authored Jan 23, 2025
  
  0da0989a
- use env variable to control the build conf on the CPU build node (#3080) · 07a22cbb
  Yineng Zhang authored Jan 23, 2025
  
  07a22cbb
- update version setup for sgl-kernel (#3079) · 3d0bfa3e
  Yineng Zhang authored Jan 23, 2025
  
  3d0bfa3e
- fix build error for sgl-kernel (#3078) · 1f6cf0d4
  Yineng Zhang authored Jan 23, 2025
  
  1f6cf0d4
- Remove torch dependency in sgl-kernel (#3074) · 553f5a3f
  Lianmin Zheng authored Jan 23, 2025
  
  553f5a3f
- support lightning_attention_decode in sgl-kernel for MiniMax-Text-01 (#3030) · ac2dc35d
  Xiaoyu Zhang authored Jan 23, 2025
  
  ac2dc35d
- docs: update developer guide for sgl-kernel (#3069) · 44e12ce4
  Yineng Zhang authored Jan 23, 2025
  
  44e12ce4
- docs: add developer guide for sgl-kernel (#3068) · a547aad6
  Yineng Zhang authored Jan 23, 2025
  
  a547aad6
22 Jan, 2025 8 commits
- add notice about flashinfer in sgl-kernel (#3057) · 806a3002
  Yineng Zhang authored Jan 23, 2025
  
  806a3002
- feat: integrate bmm_fp8 kernel into sgl-kernel (#3056) · bf669606
  Yineng Zhang authored Jan 23, 2025
  
  bf669606
- minor: update header and use pytest (#3054) · b2bd8f44
  Yineng Zhang authored Jan 22, 2025
  
  b2bd8f44
- feat: integrate activation kernels into sgl-kernel (#3053) · 9d9b482a
  Yineng Zhang authored Jan 22, 2025
  
  9d9b482a
- feat: integrate norm kernels into sgl-kernel (#3052) · 7353fb9b
  Yineng Zhang authored Jan 22, 2025
  
  7353fb9b
- sync the upstream updates of flashinfer (#3051) · bcda0c9e
  Yineng Zhang authored Jan 22, 2025
  
  bcda0c9e
- update norm cu (#3048) · 9f8f2c7f
  Yineng Zhang authored Jan 22, 2025
  
  9f8f2c7f
- Fix sgl-kernel compile for sm80 (#3046) · 6fc37bd8
  Ke Bao authored Jan 22, 2025
  
  6fc37bd8
21 Jan, 2025 4 commits
- Support sm90 Int8 gemm (#3035) · 0ac019f1
  Ke Bao authored Jan 21, 2025
  
  0ac019f1
- feat: add flashinfer as 3rdparty and use rmsnorm as example (#3033) · 5a0d680a
  Yineng Zhang authored Jan 21, 2025
  
  5a0d680a
- upgrade torch version for sgl-kernel (#3026) · ec1c21cd
  Yineng Zhang authored Jan 21, 2025
  
  ec1c21cd
- minor: update Makefile for sgl-kernel (#3025) · 6c856b4f
  Yineng Zhang authored Jan 21, 2025
  
  6c856b4f
20 Jan, 2025 2 commits
- Add compile flags for cutlass 3.x (#3013) · 5dfcacfc
  Ke Bao authored Jan 21, 2025
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  5dfcacfc
- [kernel] port rope cuda kernel to sgl-kernel (#2993) · b5caa22d
  Byron Hsu authored Jan 20, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  b5caa22d
19 Jan, 2025 2 commits
- cleanup unused header in sgl_kernel (#2986) · a69cb5cf
  Yineng Zhang authored Jan 20, 2025
  
  a69cb5cf
- remove cub and add cccl (#2976) · d33cbb7e
  Yineng Zhang authored Jan 19, 2025
  
  d33cbb7e
18 Jan, 2025 2 commits
- upgrade cutlass v3.7.0 (#2967) · e2cdc8a5
  Yineng Zhang authored Jan 18, 2025
  
  e2cdc8a5
- fix sgl-kernel setup.py (#2963) · 6f98c586
  lukec authored Jan 18, 2025
  
  6f98c586
16 Jan, 2025 2 commits
- minor: use bear for compilation database (#2919) · 75964177
  Yineng Zhang authored Jan 16, 2025
  
  75964177
- fix setup for sgl kernel (#2917) · 2dc957d4
  Yineng Zhang authored Jan 16, 2025
  
  2dc957d4
15 Jan, 2025 3 commits
- minor: rename bench for sgl kernel (#2909) · b7f3fec1
  Yineng Zhang authored Jan 16, 2025
  
  b7f3fec1
- fix: sgl-kernel link cuda (#2906) · a53454c5
  Yineng Zhang authored Jan 16, 2025
  
  a53454c5
- optimize custom allreduce kernel (#2904) · 6cb3974e
  yizhang2077 authored Jan 16, 2025
  
  6cb3974e
14 Jan, 2025 1 commit
- introduce CUB in sgl-kernel (#2887) · f005758f
  Xiaoyu Zhang authored Jan 14, 2025
  
  f005758f
13 Jan, 2025 1 commit
- Sampling penalties memory interface (#2870) · d08c77c4
  Xiaoyu Zhang authored Jan 13, 2025
  
  d08c77c4