Commits · 7e0976133ca435d5b2fa4bddff25794ddf64dabf · change / sglang · GitLab

26 Jan, 2025 14 commits
- udpate sgl-kernel version for srt (#3150) · 7e097613
  Yineng Zhang authored Jan 26, 2025
  
  7e097613
- Temporarily skip the openai frontend tests (#3151) · f4a92f4b
  Lianmin Zheng authored Jan 26, 2025
  
  f4a92f4b
- chore: bump 0.0.2.post18 for sgl-kernel (#3149) · 318260c0
  Yineng Zhang authored Jan 26, 2025
  
  318260c0
- Do not load OPENAI_KEY from secrets (#3147) · 4a612531
  Lianmin Zheng authored Jan 26, 2025
  
  4a612531
- Add a test case for cached_tokens (#3145) · d1a08632
  Lianmin Zheng authored Jan 26, 2025
  
  d1a08632
- Add CPU affinity setting to latency benchmark (#3085) · f8b28e46
  Hubert Lu authored Jan 25, 2025
  
  f8b28e46
- support w8a8 fp8 kernel with CUTLASS (#3047) · 82392da8
  HandH1998 authored Jan 26, 2025
```
Co-authored-by: yych0745 <1398089567@qq.com>
```
  82392da8
- minor: cleanup sgl-kernel (#3143) · 95f789ad
  Yineng Zhang authored Jan 26, 2025
  
  95f789ad
- Fix repetition penalty (#3139) · 4f118a39
  Lianmin Zheng authored Jan 25, 2025
  
  4f118a39
- [Fix] Not skip NVML Check on AMD Platform (#3135) · 66283dbc
  yigex authored Jan 26, 2025
  
  66283dbc
- feat: cross python wheel for sgl-kernel (#3138) · 822bae8c
  Yineng Zhang authored Jan 26, 2025
  
  822bae8c
- enable kv_scale for Gemma2 (#3113) · 8e48ca8c
  Hui Liu authored Jan 25, 2025
  
  8e48ca8c
- Use torch.compile for scaling penalty (#3133) · 27acf63b
  Lianmin Zheng authored Jan 25, 2025
  
  27acf63b
- Fix CI tests (#3132) · da6f8081
  Lianmin Zheng authored Jan 25, 2025
  
  da6f8081
25 Jan, 2025 8 commits
- feat: refactor sgl-kernel and use TORCH_LIBRARY instead of PYBIND11_MODULE for custom ops (#3130) · 9286740e
  yinfan98 authored Jan 26, 2025
```
Co-authored-by: yinfan.1024 <yinfan.1024@bytedance.com>
Co-authored-by: yinfan98 <1106110035@qq.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  9286740e
- update installation doc for sgl-kernel (#3129) · 896c0744
  Yineng Zhang authored Jan 26, 2025
  
  896c0744
- Update whl index path (#3128) · c23d5706
  Ke Bao authored Jan 25, 2025
  
  c23d5706
- Update tag name for whl release (#3127) · 67ad4338
  Ke Bao authored Jan 25, 2025
  
  67ad4338
- speedup pr test for sgl-kernel (#3126) · 3cab5f71
  Yineng Zhang authored Jan 25, 2025
  
  3cab5f71
- chore: bump v0.0.2.post17 for sgl-kernel (#3125) · 14e754a8
  Yineng Zhang authored Jan 25, 2025
  
  14e754a8
- mirror fix for custom allreduce (#3124) · 98522149
  yizhang2077 authored Jan 25, 2025
  
  98522149
- support fp32 in sampling_scaling_penalties kernel (#3121) · 5d9d15e7
  Xiaoyu Zhang authored Jan 25, 2025
  
  5d9d15e7
24 Jan, 2025 11 commits
- Add step to update sgl-kernel whl index (#3110) · 665e5e85
  Ke Bao authored Jan 25, 2025
  
  665e5e85
- Add workflow for sgl-kernel cu118 release (#3109) · a22f60a3
  Ke Bao authored Jan 24, 2025
  
  a22f60a3
- minor: update sgl-kernel setup (#3107) · 04f0b4cb
  Yineng Zhang authored Jan 24, 2025
  
  04f0b4cb
- [Docs] minor update for phi-3 and phi-4 (#3096) · 4505a436
  Adarsh Shirawalmath authored Jan 24, 2025
  
  4505a436
- Allow local cutlass directory to be used in sgl-kernel build (#3037) · 685a5738
  Trevor Morris authored Jan 24, 2025
  
  685a5738
- minor: sync flashinfer and add turbomind as 3rdparty (#3105) · 153b414e
  Yineng Zhang authored Jan 24, 2025
  
  153b414e
- Fix cu118 group gemm compile issue (#3097) · 6619f48e
  Ke Bao authored Jan 24, 2025
  
  6619f48e
- [router] Fix twine uploading (#3095) · 3ed0a547
  Byron Hsu authored Jan 23, 2025
  
  3ed0a547
- bump router to 0.1.4 (#3094) · 8d8ef849
  Byron Hsu authored Jan 23, 2025
  
  8d8ef849
- [router] Forward all request headers from router to workers (#3070) · 9a0cc2e9
  Byron Hsu authored Jan 23, 2025
  
  9a0cc2e9
- Add shapes for int8 gemm benchmark (#3093) · 7bad7e75
  Ke Bao authored Jan 24, 2025
  
  7bad7e75
23 Jan, 2025 7 commits
- Docs: Update doc for server arguments (#2742) · 1c4e0d24
  simveit authored Jan 23, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  1c4e0d24
- chore: bump sgl-kernel 0.0.2.post16 (#3087) · 54bac8af
  Yineng Zhang authored Jan 24, 2025
  
  54bac8af
- feat: integrate sampling kernels into sgl-kernel (#3086) · 5de4051b
  Yineng Zhang authored Jan 24, 2025
```
Co-authored-by: Zihao Ye <expye@outlook.com>
```
  5de4051b
- [hotfix] fix test_sampling_scaling_penalties.py ci test (#3084) · e0cd65c2
  Xiaoyu Zhang authored Jan 24, 2025
  
  e0cd65c2
- use flashinfer vec_dtypes in sgl_kernel (#3083) · f1b68618
  Xiaoyu Zhang authored Jan 23, 2025
  
  f1b68618
- sync flashinfer and update sgl-kernel tests (#3081) · 0da0989a
  Yineng Zhang authored Jan 23, 2025
  
  0da0989a
- use env variable to control the build conf on the CPU build node (#3080) · 07a22cbb
  Yineng Zhang authored Jan 23, 2025
  
  07a22cbb