Commits · 9c574585b3bba10b7e77cf331e02a019bda04c87 · change / sglang · GitLab

23 May, 2025 10 commits
- fix: remove content=none test when tool called (#6347) · 9c574585
  Shi Shuai authored May 24, 2025
  
  9c574585
- [PD] Support logprob & Add failure test (#6558) · 8233cc10
  Byron Hsu authored May 23, 2025
  
  8233cc10
- [2/2] Support Qserve (#6521) · 1b2e8f76
  HandH1998 authored May 24, 2025
  
  1b2e8f76
- [PD] support spec decode (#6507) · d2e0881a
  Byron Hsu authored May 23, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  d2e0881a
- Fix topk inference performance reduce (#6474) · 2f427491
  Li Hui authored May 23, 2025
  
  2f427491
- Update sgl-kernel UTs for activation/topk/norm/rope kernels (#6452) · d8189660
  YanbingJiang authored May 23, 2025
  
  d8189660
- Add fp8 fused_experts kernel for CPU in sgl-kernel and add UT (#6404) · 3ded6235
  Chunyuan WU authored May 23, 2025
  
  3ded6235
- Add fp8 qkv_proj_with_rope kernel for CPU in sgl-kernel and add UT (#6493) · 4ba1eea8
  blzheng authored May 23, 2025
  
  4ba1eea8
- [VLM] Support chunk prefill for VLM (#6355) · 4685fbb8
  Chang Su authored May 22, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  4685fbb8
- [PD] Fix failure abort (#6535) · 0a4fc73b
  Byron Hsu authored May 22, 2025
  
  0a4fc73b
22 May, 2025 16 commits
- misc: fix accept_length (#6536) · a6970a17
  Yineng Zhang authored May 22, 2025
  
  a6970a17
- Support XiaomiMiMo inference with mtp (#6059) · a6ae3af1
  ryang authored May 23, 2025
  
  a6ae3af1
- chore: upgrade sgl-kernel v0.1.4 (#6532) · 0b07c4a9
  Yineng Zhang authored May 22, 2025
  
  0b07c4a9
- Support qwen3 deepep (#6120) · fc0e3b91
  lukec authored May 23, 2025
  
  fc0e3b91
- chore: bump sgl-kernel v0.1.4 (#6522) · d71f3f0a
  Yineng Zhang authored May 22, 2025
  
  d71f3f0a
- Fix missing http status import for PD failure handler (#6520) · 58f10679
  shangmingc authored May 22, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  58f10679
- Support dynamically rebalancing experts using EPLB (#6469) · 7a80f565
  fzyzcjy authored May 22, 2025
  
  7a80f565
- Support logging expert balancedness metrics (#6482) · 9484eba4
  fzyzcjy authored May 22, 2025
  
  9484eba4
- [RL] Remove the w13 weight_scale and input_scale for UnquantizedEPMoE… (#6308) · e9feb488
  Zilin Zhu authored May 22, 2025
  
  e9feb488
- Support updating expert locations dynamically (#6388) · fc992a09
  fzyzcjy authored May 22, 2025
  
  fc992a09
- Add main for merge state tests (#6492) · 121f92c5
  Yuan Luo authored May 22, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  121f92c5
- [PD] Abort request if transfer fails (#6504) · 3bde1010
  Byron Hsu authored May 21, 2025
  
  3bde1010
- [PD] Add doc and simplify sender.send (#6019) · 75135580
  Byron Hsu authored May 21, 2025
  
  75135580
- [1/2] Support Qserve (#6457) · 4d643f6c
  HandH1998 authored May 22, 2025
```
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
```
  4d643f6c
- Apply constraint grammar to EAGLE (#6499) · 6ce0ed07
  Ke Bao authored May 22, 2025
```
Co-authored-by: merrymercy <lianminzheng@gmail.com>
```
  6ce0ed07
- Recover from corrupted cache file in bench serving (#6510) · 969660c7
  fzyzcjy authored May 22, 2025
  
  969660c7
21 May, 2025 14 commits
- doc: Update README.md with adding deepwiki badge to enable weekly auto-refresh (#6508) · 16d4f680
  Xinyuan Tong authored May 21, 2025
  
  16d4f680
- fix: EXAONE when using tie_word_embeddings (#5759) · ada268fd
  Kyungmin Lee authored May 22, 2025
  
  ada268fd
- [CPU] Fix build issue (#6419) · cfe48c59
  blzheng authored May 22, 2025
  
  cfe48c59
- [Fix]Fix capture fail bug for DeepSeek (#6275) · d4c038da
  Baizhou Zhang authored May 21, 2025
  
  d4c038da
- Fix bench_one_batch_server (#6503) · 55f6005f
  fzyzcjy authored May 22, 2025
  
  55f6005f
- Let bench_one_batch_server use sharegpt data to make expert distribution more natural (#5573) · 7222e1da
  fzyzcjy authored May 21, 2025
  
  7222e1da
- Tiny make Lint CI show diff (#6445) · 505eec4d
  fzyzcjy authored May 21, 2025
  
  505eec4d
- Support redundant experts in expert parallel (#6461) · ccfe5c00
  fzyzcjy authored May 21, 2025
  
  ccfe5c00
- Tiny add stage assertions to DeepEPDispatcher to avoid misuse (#6467) · a071dc40
  fzyzcjy authored May 21, 2025
  
  a071dc40
- Fix num_qps_per_rank computation when providing custom DeepEP configuration (#6468) · a40aecc5
  fzyzcjy authored May 21, 2025
  
  a40aecc5
- Refactor DeepSeek attention dispatching (#6476) · d6e1d28c
  fzyzcjy authored May 21, 2025
  
  d6e1d28c
- [RL] allow weight updation with dp attention enabled (#6311) · 7c347259
  Zilin Zhu authored May 21, 2025
  
  7c347259
- [router] support http2 in router (#6487) · 669caa0a
  Zilin Zhu authored May 21, 2025
  
  669caa0a
- Implement Siglip Vision model, and support BNB quantization for gemma3-mm (#5339) · 4024e1d2
  Jiajun Li authored May 20, 2025
  
  4024e1d2