Commits · d3ecd63204337acb79c152a6ea47da2a8015a46f · change / sglang · GitLab

11 Mar, 2025 4 commits
- Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136) · d3ecd632
  lambert0312 authored Mar 11, 2025
  
  d3ecd632
- bump sgl-kernel 0.0.4.post2 (#4288) · cd909455
  Yineng Zhang authored Mar 11, 2025
  
  cd909455
- update deepgemm (#4284) · bde24ab3
  Yineng Zhang authored Mar 10, 2025
  
  bde24ab3
- Uupdate cutalss dependency for its bug fix (#4277) · bf2eefc0
  Elfie Guo authored Mar 10, 2025
  
  bf2eefc0
10 Mar, 2025 21 commits
- Fix nightly eval for neuralmagic/Mixtral-8x7B-Instruct-v0.1-FP8 (#4279) · 5524e7d0
  Lianmin Zheng authored Mar 10, 2025
  
  5524e7d0
- upgrade xgrammar 0.1.15 (#4275) · e187a3d5
  Yineng Zhang authored Mar 10, 2025
  
  e187a3d5
- add THIRDPARTYNOTICES for DeepGEMM (#4272) · 3dd4feae
  Yineng Zhang authored Mar 10, 2025
  
  3dd4feae
- Amd test fp8 (#4261) · 2ac189ed
  HandH1998 authored Mar 11, 2025
  
  2ac189ed
- Test no vllm custom allreduce (#4256) · 5a6400ee
  Lianmin Zheng authored Mar 10, 2025
  
  5a6400ee
- Optimize rope in sgl kernel (#4267) · cf0ccd40
  Lianmin Zheng authored Mar 10, 2025
  
  cf0ccd40
- increase the timeout of nightly-test.yml (#4262) · 3d56585a
  Lianmin Zheng authored Mar 10, 2025
  
  3d56585a
- Fix quantization and nightly tests (#4258) · 00d25a7f
  Lianmin Zheng authored Mar 10, 2025
  
  00d25a7f
- Release sgl-kernel v0.0.4.post1 (#4255) · 1a5023e0
  Lianmin Zheng authored Mar 10, 2025
  
  1a5023e0
- fix per_token_group_quant_fp8 illegal memory when num_groups % 16 != 0 (#4231) · 23308a90
  Xiaoyu Zhang authored Mar 10, 2025
  
  23308a90
- fix the input_ids is None error (#4144) · ac698850
  shimin authored Mar 10, 2025
  
  ac698850
- Simplify tests & Fix trtllm custom allreduce registration (#4252) · aa957102
  Lianmin Zheng authored Mar 10, 2025
  
  aa957102
- Added example for multimodal embedding (#4206) · 007f8b3d
  simveit authored Mar 10, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  007f8b3d
- [Bug fixed] fixed the crash when enable the dp-attention on the single card (#3958) · 4455b26e
  DavidChan authored Mar 10, 2025
  
  4455b26e
- DeepGemm integrate to sgl-kernel (#4165) · c553e160
  laixin authored Mar 10, 2025
```
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
Co-authored-by: yinfan98 <1106310035@qq.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  c553e160
- Move activation.cu to sgl-kernel/elementwise (#4250) · 7c0541b3
  Lianmin Zheng authored Mar 09, 2025
  
  7c0541b3
- Clean up fp8 support (#4230) · e8a69e4d
  Lianmin Zheng authored Mar 09, 2025
  
  e8a69e4d
- Auto balance CI tests (#4238) · fbd56002
  Lianmin Zheng authored Mar 09, 2025
  
  fbd56002
- Minor style fix for sgl-kernel (#4243) · 730d084f
  Lianmin Zheng authored Mar 09, 2025
  
  730d084f
- Revert "Check eagle server args" (#4242) · 4a05bdfa
  Lianmin Zheng authored Mar 09, 2025
  
  4a05bdfa
- Move rope and bmm into sgl-kernel (#4241) · eb06dbcb
  Lianmin Zheng authored Mar 09, 2025
  
  eb06dbcb
09 Mar, 2025 15 commits
- Fix test of flashinfer mla with nextn (#4237) · 9dfafa74
  Baizhou Zhang authored Mar 09, 2025
  
  9dfafa74
- Update bench speculative script (#4235) · f1d09a65
  Ke Bao authored Mar 10, 2025
  
  f1d09a65
- update sgl-kernel 3rdparty (#4228) · df84ab2a
  Yineng Zhang authored Mar 09, 2025
  
  df84ab2a
- Check eagle server args (#4217) · 34c88987
  Ying Sheng authored Mar 09, 2025
  
  34c88987
- Apply sgl w8a8 fp8 kernel (#3148) · 0dd6cda2
  HandH1998 authored Mar 09, 2025
  
  0dd6cda2
- Support nextn for flashinfer mla attention backend (#4218) · 9fb48f95
  Baizhou Zhang authored Mar 09, 2025
  
  9fb48f95
- use sgl-kernel 0.0.4 (#4224) · 89ccb533
  Yineng Zhang authored Mar 08, 2025
  
  89ccb533
- [docs] Unhide production metrics page (#4193) · dceb256f
  Stefan He authored Mar 08, 2025
  
  dceb256f
- [docker] Distributed Serving with k8s Statefulset ( good example for DeepSeek-R1) (#3631) · 0e90ae62
  Peter Pan authored Mar 09, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Co-authored-by: Kebe <kebe.liu@daocloud.io>
```
  0e90ae62
- Lazily import lora backends (#4225) · 1361ab9e
  Lianmin Zheng authored Mar 08, 2025
  
  1361ab9e
- chore: bump v0.0.4 for sgl-kernel (#4223) · 5c7dd14b
  Yineng Zhang authored Mar 08, 2025
  
  5c7dd14b
- Rename files in sgl kernel to avoid nested folder structure (#4213) · 8abf74e3
  Lianmin Zheng authored Mar 08, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  8abf74e3
- use latest sgl-kernel for mla test (#4222) · ee132a45
  Yineng Zhang authored Mar 08, 2025
  
  ee132a45
- revert pr 3628 to pass test_mla ci (#4219) · 79a321af
  Xiaoyu Zhang authored Mar 09, 2025
  
  79a321af
- docs(reasoning content): 📝 deepseek-r1 parser support qwq (#4124) · 6eec3cdc
  Xihuai Wang authored Mar 09, 2025
  
  6eec3cdc