Commits · 3d56585a976b55f2554166e5af5678f07deec331 · change / sglang · GitLab

10 Mar, 2025 15 commits
- increase the timeout of nightly-test.yml (#4262) · 3d56585a
  Lianmin Zheng authored Mar 10, 2025
  
  3d56585a
- Fix quantization and nightly tests (#4258) · 00d25a7f
  Lianmin Zheng authored Mar 10, 2025
  
  00d25a7f
- Release sgl-kernel v0.0.4.post1 (#4255) · 1a5023e0
  Lianmin Zheng authored Mar 10, 2025
  
  1a5023e0
- fix per_token_group_quant_fp8 illegal memory when num_groups % 16 != 0 (#4231) · 23308a90
  Xiaoyu Zhang authored Mar 10, 2025
  
  23308a90
- fix the input_ids is None error (#4144) · ac698850
  shimin authored Mar 10, 2025
  
  ac698850
- Simplify tests & Fix trtllm custom allreduce registration (#4252) · aa957102
  Lianmin Zheng authored Mar 10, 2025
  
  aa957102
- Added example for multimodal embedding (#4206) · 007f8b3d
  simveit authored Mar 10, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  007f8b3d
- [Bug fixed] fixed the crash when enable the dp-attention on the single card (#3958) · 4455b26e
  DavidChan authored Mar 10, 2025
  
  4455b26e
- DeepGemm integrate to sgl-kernel (#4165) · c553e160
  laixin authored Mar 10, 2025
```
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
Co-authored-by: yinfan98 <1106310035@qq.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  c553e160
- Move activation.cu to sgl-kernel/elementwise (#4250) · 7c0541b3
  Lianmin Zheng authored Mar 09, 2025
  
  7c0541b3
- Clean up fp8 support (#4230) · e8a69e4d
  Lianmin Zheng authored Mar 09, 2025
  
  e8a69e4d
- Auto balance CI tests (#4238) · fbd56002
  Lianmin Zheng authored Mar 09, 2025
  
  fbd56002
- Minor style fix for sgl-kernel (#4243) · 730d084f
  Lianmin Zheng authored Mar 09, 2025
  
  730d084f
- Revert "Check eagle server args" (#4242) · 4a05bdfa
  Lianmin Zheng authored Mar 09, 2025
  
  4a05bdfa
- Move rope and bmm into sgl-kernel (#4241) · eb06dbcb
  Lianmin Zheng authored Mar 09, 2025
  
  eb06dbcb
09 Mar, 2025 15 commits
- Fix test of flashinfer mla with nextn (#4237) · 9dfafa74
  Baizhou Zhang authored Mar 09, 2025
  
  9dfafa74
- Update bench speculative script (#4235) · f1d09a65
  Ke Bao authored Mar 10, 2025
  
  f1d09a65
- update sgl-kernel 3rdparty (#4228) · df84ab2a
  Yineng Zhang authored Mar 09, 2025
  
  df84ab2a
- Check eagle server args (#4217) · 34c88987
  Ying Sheng authored Mar 09, 2025
  
  34c88987
- Apply sgl w8a8 fp8 kernel (#3148) · 0dd6cda2
  HandH1998 authored Mar 09, 2025
  
  0dd6cda2
- Support nextn for flashinfer mla attention backend (#4218) · 9fb48f95
  Baizhou Zhang authored Mar 09, 2025
  
  9fb48f95
- use sgl-kernel 0.0.4 (#4224) · 89ccb533
  Yineng Zhang authored Mar 08, 2025
  
  89ccb533
- [docs] Unhide production metrics page (#4193) · dceb256f
  Stefan He authored Mar 08, 2025
  
  dceb256f
- [docker] Distributed Serving with k8s Statefulset ( good example for DeepSeek-R1) (#3631) · 0e90ae62
  Peter Pan authored Mar 09, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Co-authored-by: Kebe <kebe.liu@daocloud.io>
```
  0e90ae62
- Lazily import lora backends (#4225) · 1361ab9e
  Lianmin Zheng authored Mar 08, 2025
  
  1361ab9e
- chore: bump v0.0.4 for sgl-kernel (#4223) · 5c7dd14b
  Yineng Zhang authored Mar 08, 2025
  
  5c7dd14b
- Rename files in sgl kernel to avoid nested folder structure (#4213) · 8abf74e3
  Lianmin Zheng authored Mar 08, 2025
```
Co-authored-by: zhyncs <me@zhyncs.com>
```
  8abf74e3
- use latest sgl-kernel for mla test (#4222) · ee132a45
  Yineng Zhang authored Mar 08, 2025
  
  ee132a45
- revert pr 3628 to pass test_mla ci (#4219) · 79a321af
  Xiaoyu Zhang authored Mar 09, 2025
  
  79a321af
- docs(reasoning content): 📝 deepseek-r1 parser support qwq (#4124) · 6eec3cdc
  Xihuai Wang authored Mar 09, 2025
  
  6eec3cdc
08 Mar, 2025 10 commits
- Split test_mla.py into two files (#4216) · 48473684
  Lianmin Zheng authored Mar 08, 2025
  
  48473684
- refine quant kernel code style (#4211) · b3251e9f
  Xiaoyu Zhang authored Mar 08, 2025
  
  b3251e9f
- Test no vllm custom allreduce (#4210) · 2cadd51d
  Lianmin Zheng authored Mar 08, 2025
  
  2cadd51d
- Refactor Dockerfile: unify CUDA logic and reduce image size by ~2.6 GB (#3749) · 4a893d14
  Kebe authored Mar 08, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  4a893d14
- Use clang format 18 in pr-test-sgl-kernel.yml (#4203) · 8d323e95
  Lianmin Zheng authored Mar 08, 2025
  
  8d323e95
- Fix bench_serving flush cache not recognizing OPENAI_API_KEY (#4181) · 0fe7c13b
  Mingshan authored Mar 08, 2025
```
Signed-off-by: Mingshan <git@brighill.com>
```
  0fe7c13b
- lazy import attn backends (#4200) · 08c4d764
  Lianmin Zheng authored Mar 08, 2025
  
  08c4d764
- Revert "Minor improvement to per_tensor_quant_fp8 (#4197)" (#4198) · 96d0e37f
  Yineng Zhang authored Mar 07, 2025
  
  96d0e37f
- Minor improvement to per_tensor_quant_fp8 (#4197) · 90bb2be2
  Rex authored Mar 07, 2025
  
  90bb2be2
- Remove the vllm dependency from the moe_align function (#4164) · b93ef5e5
  lukec authored Mar 08, 2025
```
Co-authored-by: Hongbosherlock <hongbosherlock@gmail.com>
```
  b93ef5e5