Commits · afc35ccc5e78d3bb18aa28d3fa46617995c899b7 · change / sglang · GitLab

07 Oct, 2025 1 commit
- Fix LoRA support for multimodal models (VLMs) by implementing a consistent... · afc35ccc
  Chenxi Li authored Oct 06, 2025
```
Fix LoRA support for multimodal models (VLMs) by implementing a consistent pattern for skipping vision components (#11261)
```
  afc35ccc
06 Oct, 2025 17 commits
- Rename max_micro_batch_size -> pp_max_micro_batch_size (#11279) · 708f4ff4
  Lianmin Zheng authored Oct 06, 2025
  
  708f4ff4
- [Auto Sync] Update test_utils.py (20251006) (#11280) · e2daeb35
  Lianmin Zheng authored Oct 06, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  e2daeb35
- Enable native ModelOpt quantization support (1/3) (#7149) · 155cbb51
  Zhiyu authored Oct 06, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  155cbb51
- Remove env var warnings for release (#11262) · eb30b888
  Lianmin Zheng authored Oct 06, 2025
  
  eb30b888
- chore: bump SGLang version to 0.5.3 (#11263) · a4a3d823
  sglang-bot authored Oct 06, 2025
  
  a4a3d823
- chore: bump SGLang version to 0.5.3rc2 (#11259) · 0b13cbb7
  sglang-bot authored Oct 06, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  0b13cbb7
- Support DeepSeek V3.2 Exp (#11061) · efbc687c
  fzyzcjy authored Oct 06, 2025
```
Co-authored-by: Stefan He <11166516+hebiao064@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <95566987+hnyls2002@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <56809903+fridge003@users.noreply.github.com>
Co-authored-by: DarkSharpness <76582120+darksharpness@users.noreply.github.com>
Co-authored-by: ZhengdQin <46387172+zhengdqin@users.noreply.github.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Zhengda Qin <zhengdqin@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  efbc687c
- feat: add shortcut detection for multimodal templates in Jinja format (#11209) · 0cd1996e
  Xinyuan Tong authored Oct 05, 2025
  
  0cd1996e
- update sgl kernel version to 0.3.14.post1 (#11242) · f8924ad7
  Lianmin Zheng authored Oct 05, 2025
  
  f8924ad7
- Bump torch_memory_saver 0.0.9rc2 (#11252) · 2f80bd9f
  fzyzcjy authored Oct 06, 2025
  
  2f80bd9f
- Use cu128 for torch audio to fix some CI tests (#11251) · 366a603e
  Lianmin Zheng authored Oct 05, 2025
  
  366a603e
- [quantization] Enable aiter mxfp4 fused_moe for Quark (#10048) · baee0860
  Bowen Bao authored Oct 05, 2025
```
Co-authored-by: HaiShaw <hixiao@gmail.com>
```
  baee0860
- [quantization] Fix scale remapping for mllama4 (#10042) · c7a104c1
  Bowen Bao authored Oct 05, 2025
```
Co-authored-by: HAI <hixiao@gmail.com>
```
  c7a104c1
- ci: make find_local_hf_snapshot_dir more robust (#11248) · 97d966a7
  Mick authored Oct 06, 2025
  
  97d966a7
- Fix spec_utils.py (#11247) · 8e66d87f
  sglang-bot authored Oct 05, 2025
  
  8e66d87f
- [Auto Sync] Update io_struct.py (20251004) (#11206) · 6b30e097
  Lianmin Zheng authored Oct 05, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: jzhou-xai <jzhou@x.ai>
```
  6b30e097
- Rename runner labels (#11228) · d645ae90
  Lianmin Zheng authored Oct 05, 2025
  
  d645ae90
05 Oct, 2025 5 commits
- Update transformers package version to 4.57.0 (#11222) · 652c24a6
  Xinyuan Tong authored Oct 05, 2025
```
Co-authored-by: yhyang201 <yhyang201@gmail.com>
```
  652c24a6
- Refactor and optimize mooncake CI (#11162) · c560410d
  Shangming Cai authored Oct 06, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  c560410d
- [Feat] Support Torch Symm Mem AllReduce (#10571) · 590f2da0
  Yuan Luo authored Oct 06, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  590f2da0
- Update `v1/responses` to be more OpenAI-compatible. (#9624) · 36a6b8db
  Vincent Zhong authored Oct 05, 2025
  
  36a6b8db
- Tiny `skip_sample` adjust (#11225) · 4cb5a523
  Liangsheng Yin authored Oct 05, 2025
  
  4cb5a523
04 Oct, 2025 4 commits
- EAGLE cache fix for HiCache (#11215) · 31b49c0b
  Ke Bao authored Oct 05, 2025
  
  31b49c0b
- [router] add grpc router pd mode for chat and generate (#11140) · d736e0b6
  Simo Lin authored Oct 04, 2025
  
  d736e0b6
- [fix]enable flashmla when using draft model P/D attention select (#11012) · 666da3d5
  Hank Han authored Oct 04, 2025
  
  666da3d5
- fix sampling_seed handling when deterministic is enabled (#11096) · d01b9214
  Alex Chi Z authored Oct 03, 2025
```
Signed-off-by: Alex Chi <iskyzh@gmail.com>
```
  d01b9214
03 Oct, 2025 13 commits
- fix self.enable_kv_cache_events (#11178) · c61b9a1d
  narutolhy authored Oct 03, 2025
  
  c61b9a1d
- [fix]missing prefix_lens_cpu init when p/d disaggregation (#11196) · 3c3d6255
  Hank Han authored Oct 04, 2025
  
  3c3d6255
- [Fix] Fix the bug of the calculation of base_gpu_id (dp offset) in... · 546914fa
  XSongQ authored Oct 03, 2025
```
[Fix] Fix the bug of the calculation of base_gpu_id (dp offset) in data_parallel_controller.py (#10741)
```
  546914fa
- model: support starcoder2 (#10609) · fad7ca73
  Praneth Paruchuri authored Oct 03, 2025
  
  fad7ca73
- fix 3fs indices (#10855) · 08af8ffb
  pansicheng authored Oct 04, 2025
  
  08af8ffb
- Optimize debug log position of PD abort request (#11090) · 2c7f4ca2
  Shangming Cai authored Oct 03, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  2c7f4ca2
- Fix [test]: Env:SGLANG_TORCH_PROFILER_DIR for pytest. (#10780) · 03def5e3
  shubham singhal authored Oct 03, 2025
  
  03def5e3
- Fix CUDA illegal memory access issues in speculative decoding (#10892) · 6ae3f05b
  ur4t authored Oct 03, 2025
  
  6ae3f05b
- Tiny move files to utils folder (#11166) · fdc4e1e5
  fzyzcjy authored Oct 03, 2025
  
  fdc4e1e5
- [hot-fix] Fix CI break which caused by adding `thinking_mode` in eval (#11192) · 04b86b3c
  Liangsheng Yin authored Oct 03, 2025
  
  04b86b3c
- Add --thinking-mode to run_eval (#11189) · d6777a70
  hlu1 authored Oct 03, 2025
```
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
```
  d6777a70
- [Feature] Option to save model weights to CPU when memory saver mode is enabled (#10873) · 8c574902
  Matt Nappo authored Oct 03, 2025
```
Co-authored-by: molocule <34072934+molocule@users.noreply.github.com>
```
  8c574902
- fix: radix cache memory accounting (#10637) · 1a31229c
  Alex Chi Z authored Oct 03, 2025
```
Signed-off-by: Alex Chi Z <iskyzh@gmail.com>
```
  1a31229c