Commits · d40ee62b5d1af63ee4748d70f4c290cf78e8da83 · change / sglang · GitLab

12 Mar, 2025 17 commits
- Update nightly tests (#4352) · d40ee62b
  Lianmin Zheng authored Mar 12, 2025
  
  d40ee62b
- typo: Update http_server.py (#4350) · 91b19949
  Wang Ran (汪然) authored Mar 13, 2025
  
  91b19949
- Support Blackwell Block Scale FP8 Gemm (#4278) · 7c866711
  Elfie Guo authored Mar 12, 2025
  
  7c866711
- Hierarchical Caching Refactoring and Fixing TP issue (#4082) · 10b544ae
  Zhiqiang Xie authored Mar 12, 2025
  
  10b544ae
- model: Support Janus-pro (#3203) · 01090e8a
  Mick authored Mar 13, 2025
  
  01090e8a
- remove the unused readline dependency from the Qwen2 model implementa… (#4340) · 6f43a9b9
  yych0745 authored Mar 12, 2025
  
  6f43a9b9
- [Fix] fix _yarn_linear_ramp_mask with device parameter (#4337) · 0540fef7
  JieXin Liang authored Mar 12, 2025
  
  0540fef7
- Add INT8 support MTP NextN function (#3911) · 481f608b
  lambert0312 authored Mar 12, 2025
  
  481f608b
- upgrade sgl-kernel 0.0.4.post3 (#4334) · ed91561f
  Yineng Zhang authored Mar 12, 2025
  
  ed91561f
- release 0.0.4.post3 sgl-kernel (#4331) · 6e7239f9
  Yineng Zhang authored Mar 12, 2025
  
  6e7239f9
- fix awq_dequantize (#4333) · 0a3960f2
  Yineng Zhang authored Mar 12, 2025
  
  0a3960f2
- Add awq dequantize kernel to sgl with 1x to 3x speedup (#4104) · 07f94463
  Rex authored Mar 12, 2025
  
  07f94463
- Remove vllm ops scaled fp8 quant and accelerate per token quant by 20-28% (#4215) · e0917e6b
  Stefan He authored Mar 12, 2025
```
Co-authored-by: Stefan He <bhe@linkedin.com>
```
  e0917e6b
- refine sgl_moe_align_block_size_benchmark (#4327) · 7130a7ce
  Xiaoyu Zhang authored Mar 12, 2025
  
  7130a7ce
- [Docs] Clean up benchmark_and_profiling.md (#4297) · 8f1f614e
  Michael Yao authored Mar 12, 2025
```
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
```
  8f1f614e
- Add A800 tuning configs for DeepSeek R1/V3 channel-wise INT8 (#4323) · 7140ba35
  lambert0312 authored Mar 12, 2025
  
  7140ba35
- unify is_cuda and is_hip (#4321) · d1da58e2
  Yineng Zhang authored Mar 11, 2025
  
  d1da58e2
11 Mar, 2025 13 commits
- upgrade flashinfer 0.2.3 (#4317) · 1cf63485
  Yineng Zhang authored Mar 11, 2025
```
Co-authored-by: qingquansong <qsong@linkedin.com>
```
  1cf63485
- refactor: move image processors to separate files (#4229) · ff2ce0b8
  Mick authored Mar 12, 2025
  
  ff2ce0b8
- Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220) · 0f2a2e3c
  Ximingwang-09 authored Mar 12, 2025
```
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  0f2a2e3c
- [AMD] Fix rocm sgl-kernel missing modules error (#4311) · 690e1f23
  yigex authored Mar 12, 2025
```
Co-authored-by: yiakwy-xpu-ml-framework-team <leiwang2@amd.com>
```
  690e1f23
- update doc (#4299) · 00f42707
  Yineng Zhang authored Mar 11, 2025
  
  00f42707
- Add A100 tuning configs for DeepSeek R1/V3 channel-wise INT8 (#4287) · 6a02b32d
  yych0745 authored Mar 11, 2025
```
Co-authored-by: HandH1998 <1335248067@qq.com>
```
  6a02b32d
- Update MTP doc (#4290) · 3a08f546
  Ke Bao authored Mar 11, 2025
  
  3a08f546
- linear support deepgemm (#4199) · dce303e2
  lukec authored Mar 11, 2025
```
Co-authored-by: yinfan98 <1106310035@qq.com>
```
  dce303e2
- update sgl-kernel 0.0.4.post2 (#4291) · 4d27eb9a
  Yineng Zhang authored Mar 11, 2025
  
  4d27eb9a
- Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136) · d3ecd632
  lambert0312 authored Mar 11, 2025
  
  d3ecd632
- bump sgl-kernel 0.0.4.post2 (#4288) · cd909455
  Yineng Zhang authored Mar 11, 2025
  
  cd909455
- update deepgemm (#4284) · bde24ab3
  Yineng Zhang authored Mar 10, 2025
  
  bde24ab3
- Uupdate cutalss dependency for its bug fix (#4277) · bf2eefc0
  Elfie Guo authored Mar 10, 2025
  
  bf2eefc0
10 Mar, 2025 10 commits
- Fix nightly eval for neuralmagic/Mixtral-8x7B-Instruct-v0.1-FP8 (#4279) · 5524e7d0
  Lianmin Zheng authored Mar 10, 2025
  
  5524e7d0
- upgrade xgrammar 0.1.15 (#4275) · e187a3d5
  Yineng Zhang authored Mar 10, 2025
  
  e187a3d5
- add THIRDPARTYNOTICES for DeepGEMM (#4272) · 3dd4feae
  Yineng Zhang authored Mar 10, 2025
  
  3dd4feae
- Amd test fp8 (#4261) · 2ac189ed
  HandH1998 authored Mar 11, 2025
  
  2ac189ed
- Test no vllm custom allreduce (#4256) · 5a6400ee
  Lianmin Zheng authored Mar 10, 2025
  
  5a6400ee
- Optimize rope in sgl kernel (#4267) · cf0ccd40
  Lianmin Zheng authored Mar 10, 2025
  
  cf0ccd40
- increase the timeout of nightly-test.yml (#4262) · 3d56585a
  Lianmin Zheng authored Mar 10, 2025
  
  3d56585a
- Fix quantization and nightly tests (#4258) · 00d25a7f
  Lianmin Zheng authored Mar 10, 2025
  
  00d25a7f
- Release sgl-kernel v0.0.4.post1 (#4255) · 1a5023e0
  Lianmin Zheng authored Mar 10, 2025
  
  1a5023e0
- fix per_token_group_quant_fp8 illegal memory when num_groups % 16 != 0 (#4231) · 23308a90
  Xiaoyu Zhang authored Mar 10, 2025
  
  23308a90