Commits · afc35ccc5e78d3bb18aa28d3fa46617995c899b7 · change / sglang

07 Oct, 2025 1 commit
- Fix LoRA support for multimodal models (VLMs) by implementing a consistent... · afc35ccc
  Chenxi Li authored Oct 06, 2025
```
Fix LoRA support for multimodal models (VLMs) by implementing a consistent pattern for skipping vision components (#11261)
```
  afc35ccc
06 Oct, 2025 2 commits

Support DeepSeek V3.2 Exp (#11061) · efbc687c

fzyzcjy authored Oct 06, 2025


Co-authored-by: Stefan He <11166516+hebiao064@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <95566987+hnyls2002@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <56809903+fridge003@users.noreply.github.com>
Co-authored-by: DarkSharpness <76582120+darksharpness@users.noreply.github.com>
Co-authored-by: ZhengdQin <46387172+zhengdqin@users.noreply.github.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Zhengda Qin <zhengdqin@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

efbc687c

[quantization] Fix scale remapping for mllama4 (#10042) · c7a104c1
Bowen Bao authored Oct 05, 2025
```
Co-authored-by: HAI <hixiao@gmail.com>
```
c7a104c1

05 Oct, 2025 1 commit
- Update transformers package version to 4.57.0 (#11222) · 652c24a6
  Xinyuan Tong authored Oct 05, 2025
```
Co-authored-by: yhyang201 <yhyang201@gmail.com>
```
  652c24a6
03 Oct, 2025 2 commits
- model: support starcoder2 (#10609) · fad7ca73
  Praneth Paruchuri authored Oct 03, 2025
  
  fad7ca73
- Tiny move files to utils folder (#11166) · fdc4e1e5
  fzyzcjy authored Oct 03, 2025
  
  fdc4e1e5
02 Oct, 2025 7 commits
- Tiny cleanup deepseek_v2.py (#11163) · b65db028
  fzyzcjy authored Oct 02, 2025
  
  b65db028
- [model] Add mamba2 and Falcon-H1 support. (#10988) · 083629c2
  ilyasch2 authored Oct 02, 2025
```
Co-authored-by: Younes Belkada <younes.belkada@tii.ae>
Co-authored-by: Younes B <49240599+younesbelkada@users.noreply.github.com>
```
  083629c2
- Support single batch overlap (#10422) · 5e786cca
  fzyzcjy authored Oct 02, 2025
  
  5e786cca
- Support dispatch low latency (#10263) · 0b9dfba7
  fzyzcjy authored Oct 02, 2025
```
Co-authored-by: Kaixi Hou <4001424+kaixih@users.noreply.github.com>
```
  0b9dfba7
- Fuse quantize and rope in trtllm_mla MTP (#10779) · f35def86
  fzyzcjy authored Oct 02, 2025
  
  f35def86
- Tiny fix missing alt stream in nextn layer (#10768) · d61615fe
  fzyzcjy authored Oct 02, 2025
  
  d61615fe
- Fix DeepSeek chunked prefill memory issue (#11149) · 44b1fbe2
  fzyzcjy authored Oct 02, 2025
  
  44b1fbe2
01 Oct, 2025 1 commit
- Quick Fix: fix Qwen3-VL launch failure caused by MRotaryEmbedding arg (#10985) · 61305291
  yhyang201 authored Oct 01, 2025
  
  61305291
30 Sep, 2025 1 commit
- Support Dots.ocr model (#11071) · fb367acf
  qrskannbara authored Oct 01, 2025
  
  fb367acf
29 Sep, 2025 3 commits
- fix: fp8 mllama4 without vision modules being quantized (#10611) · 9de1320b
  Mick authored Sep 30, 2025
  
  9de1320b
- Use more general heuristics to set the default value of --mem-fraction-static (#10975) · a17e70f5
  Lianmin Zheng authored Sep 29, 2025
```
Co-authored-by: sglang-bot <sglangbot@gmail.com>
```
  a17e70f5
- Fix gemma 3 launch with `transformers:` the error: `AttributeError:... · 71959545
  Vincent Zhong authored Sep 29, 2025
```
Fix gemma 3 launch with `transformers:` the error: `AttributeError: 'TransformersForCausalLM' object has no attribute 'tp_size'` (#9614)
```
  71959545
28 Sep, 2025 1 commit
- Update GLM-4.5 Model Doc (#11017) · abb67815
  Yuxuan Zhang authored Sep 29, 2025
  
  abb67815
27 Sep, 2025 1 commit
- fix: fp8 quantization failure of qwen 2.5 VL 7B model (#10112) · 82605747
  Yueyang Pan authored Sep 27, 2025
```
Signed-off-by: PanJason <pyyjason@gmail.com>
```
  82605747
26 Sep, 2025 1 commit
- Fuse write kv buffer into rope for qwen3 moe & bailing moe (#10749) · a5095d62
  Yuan Luo authored Sep 26, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  a5095d62
24 Sep, 2025 1 commit
- fix bailing_moe with enable_dp_attention (#10860) · cd641a99
  GuoweiWangU authored Sep 24, 2025
  
  cd641a99
23 Sep, 2025 4 commits

Remove duplicate code in qwen2 model (#10540) · d42975c6
Lzhang-hub authored Sep 24, 2025

d42975c6

model: support qwen3-vl series (#10323) · 4f564b9e

Zheng Li authored Sep 24, 2025


Co-authored-by: ocss884 <ocss.lin@gmail.com>
Co-authored-by: cao1zhg <653506626@qq.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: 瑀澈 <yuche.lz@alibaba-inc.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

4f564b9e

[Ascend]optimize Qwen3 on Ascend (#10574) · e22f3a5e
ronnie_zheng authored Sep 23, 2025
```
Co-authored-by: c30031083 <chenxu140@huawei.com>
```
e22f3a5e
[Feature] Add MLAProcess for DeepSeek MLA on NPU (#10130) · d27a6f70
Even Zhou authored Sep 23, 2025

d27a6f70

22 Sep, 2025 2 commits
- Fix multimodal registry and code sync scripts (#10759) · 38c00ed7
  Lianmin Zheng authored Sep 22, 2025
```
Co-authored-by: cctry <shiyang@x.ai>
```
  38c00ed7
- [Auto Sync] Update deepseek_v2.py (20250922) (#10717) · f67d1f45
  Yineng Zhang authored Sep 21, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Michael Granado <mgranado@together.ai>
```
  f67d1f45
20 Sep, 2025 2 commits
- fix: remove awq_dequantize deps (#10686) · 7c876de7
  Yineng Zhang authored Sep 20, 2025
  
  7c876de7
- [Auto Sync] Update deepseek_v2.py (20250920) (#10683) · b17e67df
  Yineng Zhang authored Sep 19, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
```
  b17e67df
19 Sep, 2025 1 commit
- model support: Sarashina2VisionForCausalLM (#10632) · c1815a99
  Chang Su authored Sep 18, 2025
  
  c1815a99
18 Sep, 2025 1 commit
- support qwen3-next-fp8 deepep (#10622) · 1344ebc8
  Yi Zhang authored Sep 19, 2025
  
  1344ebc8
17 Sep, 2025 2 commits
- Remove duplicated code (#10545) · 4f9e71df
  Yichen Yan authored Sep 17, 2025
```
Co-authored-by: jiapingW <56055330+jiapingW@users.noreply.github.com>
```
  4f9e71df
- enable prefix cache with dp (#10459) · 124097fc
  Shu Wang authored Sep 16, 2025
  
  124097fc
16 Sep, 2025 5 commits
- support using fa4 on deepseek on blackwell (#9928) · a2f7218a
  cicirori authored Sep 17, 2025
  
  a2f7218a
- Minor fix lint introduced by #10466 (#10507) · edd6a07b
  Shangming Cai authored Sep 16, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  edd6a07b
- feat: update support for qwen3next model (#10466) · b6dd4bcb
  cao1zhg authored Sep 16, 2025
  
  b6dd4bcb
- Remove wrong imports `from sglang.python` (#10493) · fa5d0bf6
  Liangsheng Yin authored Sep 16, 2025
  
  fa5d0bf6
- [Auto Sync] Update registry.py (20250915) (#10484) · 31fb19a0
  Lianmin Zheng authored Sep 15, 2025
```
Co-authored-by: cctry <shiyang@x.ai>
```
  31fb19a0
15 Sep, 2025 1 commit
- model: support solar (#8189) · a45d9a4e
  Praneth Paruchuri authored Sep 15, 2025
  
  a45d9a4e