Commits · 88596739a4637ad10a98d09473e71cee8064b9ec · change / sglang

27 Oct, 2025 3 commits
- Add support for Matryoshka embeddings (#126) (#11142) · 9fc3e8aa
  satyamk7054 authored Oct 27, 2025
```
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
```
  9fc3e8aa
- [doc] add example of using w4fp8 for Deepseek (#12057) · c8d385ce
  Kevin_Xiong authored Oct 27, 2025
```
Co-authored-by: Chao Xiong <chaoxiong@Chaos-MacBook-Air.local>
```
  c8d385ce
- chore: bump SGLang version to 0.5.4.post1 (#12169) · 55d75e11
  sglang-bot authored Oct 27, 2025
  
  55d75e11
24 Oct, 2025 3 commits
- Revert "lang: support direct video inference" (#12038) · ffc722a6
  Lianmin Zheng authored Oct 23, 2025
  
  ffc722a6
- lang: support direct video inference (#9936) · 823b4429
  Mick authored Oct 24, 2025
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  823b4429
- chore: bump SGLang version to 0.5.4 (#12027) · 1053e1be
  sglang-bot authored Oct 24, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  1053e1be
23 Oct, 2025 1 commit
- fix(deepep): resolve benchmark failure on 4×IB-card setup by aligning tuning... · 81fd2b0e
  Zhengyi Lai authored Oct 23, 2025
```
fix(deepep): resolve benchmark failure on 4×IB-card setup by aligning tuning config with DeepEP commit bdd119f8 (#11965)
```
  81fd2b0e
22 Oct, 2025 1 commit
- [lint] improve ruff check (#11922) · 9d61205d
  Liangsheng Yin authored Oct 22, 2025
```
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
```
  9d61205d
21 Oct, 2025 1 commit
- vlm: enforce pybase64 for image and str encode/decode (#10700) · d0a64c7e
  b8zhong authored Oct 21, 2025
  
  d0a64c7e
18 Oct, 2025 1 commit
- [Refactor] move `deep_gemm_wrapper` out of `quantization` (#11784) · 5b214b50
  Cheng Wan authored Oct 17, 2025
  
  5b214b50
17 Oct, 2025 1 commit
- Revert "Set csgmv as default lora backend. (#11488)" (#11735) · da681f35
  Yineng Zhang authored Oct 17, 2025
  
  da681f35
16 Oct, 2025 2 commits
- chore: bump SGLang version to 0.5.3.post3 (#11693) · 85ebeecf
  sglang-bot authored Oct 16, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  85ebeecf
- Set csgmv as default lora backend. (#11488) · b0d20cde
  Lifu Huang authored Oct 15, 2025
  
  b0d20cde
15 Oct, 2025 1 commit
- chore: bump SGLang version to 0.5.3.post2 (#11680) · baf277a9
  sglang-bot authored Oct 15, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  baf277a9
09 Oct, 2025 1 commit
- chore: bump SGLang version to 0.5.3.post1 (#11324) · 758b887a
  sglang-bot authored Oct 09, 2025
  
  758b887a
08 Oct, 2025 1 commit
- [8/N] MoE Refactor: deprecate `EPMoE` (#11211) · 3c06b673
  Cheng Wan authored Oct 07, 2025
  
  3c06b673
07 Oct, 2025 1 commit
- [sgl-kernel] Support float64 moe_sum_reduce cuda kernel (#11068) · 4f42c8cd
  Yuan Luo authored Oct 07, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  4f42c8cd
06 Oct, 2025 2 commits
- chore: bump SGLang version to 0.5.3 (#11263) · a4a3d823
  sglang-bot authored Oct 06, 2025
  
  a4a3d823
- chore: bump SGLang version to 0.5.3rc2 (#11259) · 0b13cbb7
  sglang-bot authored Oct 06, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  0b13cbb7
05 Oct, 2025 2 commits
- [Feat] Support Torch Symm Mem AllReduce (#10571) · 590f2da0
  Yuan Luo authored Oct 06, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  590f2da0
- Add --max-new-tokens CLI flag for MMMU evaluation (#11217) · 48e9e719
  yhyang201 authored Oct 05, 2025
  
  48e9e719
03 Oct, 2025 1 commit
- Tiny move files to utils folder (#11166) · fdc4e1e5
  fzyzcjy authored Oct 03, 2025
  
  fdc4e1e5
28 Sep, 2025 1 commit

[sgl-kernel] Optimize concat_mla_k kernel (#10543) · 42245551

Yuan Luo authored Sep 28, 2025


Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: PGFLMG <1106310035@qq.com>

42245551

25 Sep, 2025 1 commit
- Add fuse_moe per-channel tune (#10915) · 77830a26
  lukec authored Sep 25, 2025
  
  77830a26
24 Sep, 2025 1 commit
- Restruct sgl-kernel benchmark (#10861) · c4e314f9
  Xiaoyu Zhang authored Sep 25, 2025
  
  c4e314f9
23 Sep, 2025 2 commits
- add tunning files for QWEN-3-NEXT (#10794) · 984730b7
  Yiakwy authored Sep 24, 2025
  
  984730b7
- fix ceval (#10504) · adc24a3a
  ZhengHSI authored Sep 24, 2025
```
Co-authored-by: lukec <118525388+sleepcoo@users.noreply.github.com>
```
  adc24a3a
19 Sep, 2025 1 commit

[sgl-kernel] Support moe_sum_reduce cuda kernel (#10321) · 616a3e20

Yuan Luo authored Sep 19, 2025


Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>

616a3e20

18 Sep, 2025 1 commit
- [improvement] add average input/output token length for hicache benchmark stats output (#10525) · 7a68b422
  zhannngchen authored Sep 18, 2025
  
  7a68b422
17 Sep, 2025 1 commit
- [bugfix]hicache bench_long_context.py run failed (#10523) · 541551ce
  zhannngchen authored Sep 17, 2025
  
  541551ce
16 Sep, 2025 1 commit
- [Hicache] Evaluate Per-Round Metrics in Multiturn Bench (#10203) · 4bb08f6e
  ykwd authored Sep 16, 2025
```
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
```
  4bb08f6e
15 Sep, 2025 3 commits
- chore: bump v0.5.3rc0 (#10468) · 86a32bb5
  Yineng Zhang authored Sep 15, 2025
  
  86a32bb5
- [HotFix]: Hot fix import path in 3fs_bench_client.py (#10463) · 2a37b24d
  hzh0425 authored Sep 15, 2025
  
  2a37b24d
- [docs / oneliner] update mmmu docs instruction (#9768) · 1489cd6c
  Vincent Zhong authored Sep 14, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  1489cd6c
12 Sep, 2025 2 commits

model: support dots.vlm1 model (#8778) · 1b1701f1

chenge@xiaohongshu.com authored Sep 12, 2025


Co-authored-by: weishi <bushou@xiaohongshu.com>
Co-authored-by: Ezra-Yu <1105212286@qq.com>
Co-authored-by: Jianfei Wang <905787410@qq.com>
Co-authored-by: qianwu <wangjianfei@xiaohongshu.com>

1b1701f1

Support LingV2 model (#10359) · fac07c9b

strgrb authored Sep 12, 2025


Co-authored-by: 羽癫 <yudian.zy@antgroup.com>
Co-authored-by: guoyuhong <yuhong.gyh@antgroup.com>

fac07c9b

11 Sep, 2025 1 commit
- chore: bump v0.5.2 (#10221) · b0d25e72
  Yineng Zhang authored Sep 11, 2025
  
  b0d25e72
10 Sep, 2025 1 commit
- [Benchmark] Prefil-only benchmark scripts (#10240) · a1d03892
  Sundara Raman Ramachandran authored Sep 09, 2025
  
  a1d03892
07 Sep, 2025 1 commit

Optimize moe_sum_reduce_kernel (#9477) · cb3918a0

Yuan Luo authored Sep 07, 2025


Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>

cb3918a0

06 Sep, 2025 1 commit
- Add lora_path argument to bench_multiturn.py (#10092) · beac202b
  Baizhou Zhang authored Sep 05, 2025
  
  beac202b