Commits · 7130a7cea9cec6161d458c2eea718ea4ce2c1324 · change / sglang · GitLab

12 Mar, 2025 4 commits
- refine sgl_moe_align_block_size_benchmark (#4327) · 7130a7ce
  Xiaoyu Zhang authored Mar 12, 2025
  
  7130a7ce
- [Docs] Clean up benchmark_and_profiling.md (#4297) · 8f1f614e
  Michael Yao authored Mar 12, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  8f1f614e
- Add A800 tuning configs for DeepSeek R1/V3 channel-wise INT8 (#4323) · 7140ba35
  lambert0312 authored Mar 12, 2025
  
  7140ba35
- unify is_cuda and is_hip (#4321) · d1da58e2
  Yineng Zhang authored Mar 11, 2025
  
  d1da58e2
11 Mar, 2025 13 commits
- upgrade flashinfer 0.2.3 (#4317) · 1cf63485
  Yineng Zhang authored Mar 11, 2025
```
Co-authored-by: qingquansong <qsong@linkedin.com>
```
  1cf63485
- refactor: move image processors to separate files (#4229) · ff2ce0b8
  Mick authored Mar 12, 2025
  
  ff2ce0b8
- Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220) · 0f2a2e3c
  Ximingwang-09 authored Mar 12, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  0f2a2e3c
- [AMD] Fix rocm sgl-kernel missing modules error (#4311) · 690e1f23
  yigex authored Mar 12, 2025
```
Co-authored-by: yiakwy-xpu-ml-framework-team <leiwang2@amd.com>
```
  690e1f23
- update doc (#4299) · 00f42707
  Yineng Zhang authored Mar 11, 2025
  
  00f42707
- Add A100 tuning configs for DeepSeek R1/V3 channel-wise INT8 (#4287) · 6a02b32d
  yych0745 authored Mar 11, 2025
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  6a02b32d
- Update MTP doc (#4290) · 3a08f546
  Ke Bao authored Mar 11, 2025
  
  3a08f546
- linear support deepgemm (#4199) · dce303e2
  lukec authored Mar 11, 2025
```
Co-authored-by: yinfan98 <1106310035@qq.com>
```
  dce303e2
- update sgl-kernel 0.0.4.post2 (#4291) · 4d27eb9a
  Yineng Zhang authored Mar 11, 2025
  
  4d27eb9a
- Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136) · d3ecd632
  lambert0312 authored Mar 11, 2025
  
  d3ecd632
- bump sgl-kernel 0.0.4.post2 (#4288) · cd909455
  Yineng Zhang authored Mar 11, 2025
  
  cd909455
- update deepgemm (#4284) · bde24ab3
  Yineng Zhang authored Mar 10, 2025
  
  bde24ab3
- Uupdate cutalss dependency for its bug fix (#4277) · bf2eefc0
  Elfie Guo authored Mar 10, 2025
  
  bf2eefc0
10 Mar, 2025 21 commits
- Fix nightly eval for neuralmagic/Mixtral-8x7B-Instruct-v0.1-FP8 (#4279) · 5524e7d0
  Lianmin Zheng authored Mar 10, 2025
  
  5524e7d0
- upgrade xgrammar 0.1.15 (#4275) · e187a3d5
  Yineng Zhang authored Mar 10, 2025
  
  e187a3d5
- add THIRDPARTYNOTICES for DeepGEMM (#4272) · 3dd4feae
  Yineng Zhang authored Mar 10, 2025
  
  3dd4feae
- Amd test fp8 (#4261) · 2ac189ed
  HandH1998 authored Mar 11, 2025
  
  2ac189ed
- Test no vllm custom allreduce (#4256) · 5a6400ee
  Lianmin Zheng authored Mar 10, 2025
  
  5a6400ee
- Optimize rope in sgl kernel (#4267) · cf0ccd40
  Lianmin Zheng authored Mar 10, 2025
  
  cf0ccd40
- increase the timeout of nightly-test.yml (#4262) · 3d56585a
  Lianmin Zheng authored Mar 10, 2025
  
  3d56585a
- Fix quantization and nightly tests (#4258) · 00d25a7f
  Lianmin Zheng authored Mar 10, 2025
  
  00d25a7f
- Release sgl-kernel v0.0.4.post1 (#4255) · 1a5023e0
  Lianmin Zheng authored Mar 10, 2025
  
  1a5023e0
- fix per_token_group_quant_fp8 illegal memory when num_groups % 16 != 0 (#4231) · 23308a90
  Xiaoyu Zhang authored Mar 10, 2025
  
  23308a90
- fix the input_ids is None error (#4144) · ac698850
  shimin authored Mar 10, 2025
  
  ac698850
- Simplify tests & Fix trtllm custom allreduce registration (#4252) · aa957102
  Lianmin Zheng authored Mar 10, 2025
  
  aa957102
- Added example for multimodal embedding (#4206) · 007f8b3d
  simveit authored Mar 10, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  007f8b3d
- [Bug fixed] fixed the crash when enable the dp-attention on the single card (#3958) · 4455b26e
  DavidChan authored Mar 10, 2025
  
  4455b26e
- DeepGemm integrate to sgl-kernel (#4165) · c553e160
  laixin authored Mar 10, 2025
```
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
Co-authored-by: yinfan98 <1106310035@qq.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  c553e160
- Move activation.cu to sgl-kernel/elementwise (#4250) · 7c0541b3
  Lianmin Zheng authored Mar 09, 2025
  
  7c0541b3
- Clean up fp8 support (#4230) · e8a69e4d
  Lianmin Zheng authored Mar 09, 2025
  
  e8a69e4d
- Auto balance CI tests (#4238) · fbd56002
  Lianmin Zheng authored Mar 09, 2025
  
  fbd56002
- Minor style fix for sgl-kernel (#4243) · 730d084f
  Lianmin Zheng authored Mar 09, 2025
  
  730d084f
- Revert "Check eagle server args" (#4242) · 4a05bdfa
  Lianmin Zheng authored Mar 09, 2025
  
  4a05bdfa
- Move rope and bmm into sgl-kernel (#4241) · eb06dbcb
  Lianmin Zheng authored Mar 09, 2025
  
  eb06dbcb
09 Mar, 2025 2 commits
- Fix test of flashinfer mla with nextn (#4237) · 9dfafa74
  Baizhou Zhang authored Mar 09, 2025
  
  9dfafa74
- Update bench speculative script (#4235) · f1d09a65
  Ke Bao authored Mar 10, 2025
  
  f1d09a65