Commits · 28b0a62bb3032f9fb5ec505c7fc773cea4e19a08 · change / sglang · GitLab

02 Feb, 2025 5 commits
- Bug: Fix min_p sampling crash when using flashinfer backend (#3207) · 28b0a62b
  zifeitong authored Feb 02, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  28b0a62b
- ROCm: bump 6.3.0 (#3259) · 566d61d9
  HAI authored Feb 02, 2025
  
  566d61d9
- Docs: Update accuracy evaluation (#3261) · 55f5fc68
  Chayenne authored Feb 02, 2025
  
  55f5fc68
- docs/accuracy evaluation (#3114) · c27c378a
  simveit authored Feb 02, 2025
```
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  c27c378a
- Tune paged attention parameters for AMD GPU. (#3255) · d9eb9358
  Wen-Heng (Jack) Chung authored Feb 01, 2025
  
  d9eb9358
01 Feb, 2025 7 commits
- use srt VocabParallelEmbedding (#3252) · 959dca4f
  Yineng Zhang authored Feb 01, 2025
  
  959dca4f
- Update README · f2b3a318
  Yineng Zhang authored Feb 01, 2025
  
  f2b3a318
- add contact us in README (#3251) · ad674097
  Yineng Zhang authored Feb 01, 2025
  
  ad674097
- support QuickGELU (#3250) · 8db776f0
  Yineng Zhang authored Feb 01, 2025
  
  8db776f0
- update and simplify CustomOp (#3249) · 4eb4b401
  Yineng Zhang authored Feb 01, 2025
  
  4eb4b401
- update ENV to ROCm dockers (#3248) · 17dbf976
  HAI authored Feb 01, 2025
  
  17dbf976
- Add test for fp8 torch compile (#3246) · 53179026
  Ke Bao authored Feb 01, 2025
  
  53179026
31 Jan, 2025 14 commits
- [Docs] Add more details to profiling docs (#3221) · d7c0b32f
  Wenxuan Tan authored Jan 31, 2025
  
  d7c0b32f
- add tuning block wise fp8 (#3242) · 7b020cca
  Yineng Zhang authored Feb 01, 2025
```
Co-authored-by: HandH1998 <007aabbcc411@gmail.com>
```
  7b020cca
- update cutlass dependency (#3240) · 7876279e
  Yineng Zhang authored Feb 01, 2025
  
  7876279e
- update sgl-kernel version for sglang (#3238) · 34e405e0
  Yineng Zhang authored Feb 01, 2025
  
  34e405e0
- Optimize MoE topk with torch compile (#3236) · 1ebe1d6d
  Ke Bao authored Feb 01, 2025
  
  1ebe1d6d
- compatible with flashinfer v0.2 (#3235) · 7811bfda
  Yineng Zhang authored Feb 01, 2025
  
  7811bfda
- Docs: Quick fix for Speculative_decoding doc (#3228) · 656f7fc1
  Jhin authored Jan 31, 2025
```
Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  656f7fc1
- chore: bump v0.4.2.post1 (#3233) · cf0f7eaf
  Yineng Zhang authored Jan 31, 2025
  
  cf0f7eaf
- support 12.5 CUDA runtime (#3231) · b49d6d0f
  Yineng Zhang authored Jan 31, 2025
  
  b49d6d0f
- Fix block wise fp8 torch compile (#3232) · c02e3139
  Ke Bao authored Jan 31, 2025
  
  c02e3139
- [fix] Clamp logprob with dtype min to prevent `-inf` (#3224) · 734daedd
  Byron Hsu authored Jan 31, 2025
  
  734daedd
- revert the MoE dependence (#3230) · 3ee62235
  Yineng Zhang authored Jan 31, 2025
  
  3ee62235
- Docs: Update supported models with Mistral 3 (#3229) · 9829e77e
  Ravi Theja authored Jan 31, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  9829e77e
- docs: add Novita for adoption and sponsorship (#3227) · cde4bbd5
  Ying Sheng authored Jan 30, 2025
  
  cde4bbd5
30 Jan, 2025 6 commits
- keep the parts needed for moe_kernels (#3218) · 9602c2aa
  Yineng Zhang authored Jan 31, 2025
  
  9602c2aa
- add tensorrt_llm moe_gemm as 3rdparty (#3217) · e81d7f11
  Yineng Zhang authored Jan 30, 2025
  
  e81d7f11
- add tensorrt_llm common and cutlass_extensions as 3rdparty (#3216) · 222ce6f1
  Yineng Zhang authored Jan 30, 2025
```
Co-authored-by: BBuf <35585791+BBuf@users.noreply.github.com>
```
  222ce6f1
- update setup for sgl-kernel (#3214) · 468d23cf
  Yineng Zhang authored Jan 30, 2025
  
  468d23cf
- update 3rdparty and rms norm for sgl-kernel (#3213) · c38b5fb4
  Yineng Zhang authored Jan 30, 2025
  
  c38b5fb4
- [test] Lower number of top logprobs to get rid of `-inf` (#3212) · 20453cef
  Byron Hsu authored Jan 30, 2025
  
  20453cef
28 Jan, 2025 6 commits
- [Fix] Address remaining issues of supporting MiniCPMV (#2977) · 9f635ea5
  Mick authored Jan 28, 2025
  
  9f635ea5
- Fix typo in README (#3190) · 76285fde
  Fidel González authored Jan 28, 2025
  
  76285fde
- [kernel] Use sgl_kernel rope (#3169) · 988d0a4b
  Byron Hsu authored Jan 27, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  988d0a4b
- clean up useless file (#3192) · 81262c7b
  Xiaoyu Zhang authored Jan 28, 2025
  
  81262c7b
- [test] deduplicate test_session_control (#3183) · 27aeb4b7
  Byron Hsu authored Jan 27, 2025
  
  27aeb4b7
- Docs fix about EAGLE and streaming output (#3166) · 7b9b4f44
  Jhin authored Jan 27, 2025
```
Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Jhin <jhinpan@umich.edu>
```
  7b9b4f44
27 Jan, 2025 2 commits
- Sanity check to prevent performance regression (#3171) · 08104b56
  Zhiqiang Xie authored Jan 27, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  08104b56
- fix: update Dockerfile for cu118 (#3181) · cf142b6e
  Yineng Zhang authored Jan 27, 2025
  
  cf142b6e