Commits · 64582caa845d9665c5359fb61179895af4e80bd4 · change / sglang

"vscode:/vscode.git/clone" did not exist on "cc93c45fa4106b6aa25a07d379439061856b625d"

07 Oct, 2025 17 commits
- [router][grpc] Refactor chat template content format detection (#11288) · 64582caa
  Chang Su authored Oct 07, 2025
  
  64582caa
- [router] add get server info and get model info in grpc server (#11303) · 2fcd56ea
  Simo Lin authored Oct 07, 2025
  
  2fcd56ea
- [Docs] [Router] Update Observability and Common Issues Section (#11302) · 0958a397
  Wenyi Xu authored Oct 07, 2025
  
  0958a397
- [sgl-kernel] Support float64 moe_sum_reduce cuda kernel (#11068) · 4f42c8cd
  Yuan Luo authored Oct 07, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  4f42c8cd
- Introduce future indices (#11301) · 3ddd7dc9
  Liangsheng Yin authored Oct 07, 2025
  
  3ddd7dc9
- Remove sampling info events and overlap thread file (#11300) · 501dfa6b
  Liangsheng Yin authored Oct 07, 2025
  
  501dfa6b
- [router] add reasoning and tool parser argument in router (#11290) · 79d34951
  Simo Lin authored Oct 07, 2025
  
  79d34951
- Remove overlap thread (#11210) · 1519a89c
  Liangsheng Yin authored Oct 07, 2025
```
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  1519a89c
- EAGLE cache fix for SWARadixCache (#11231) · 24bc3fb0
  Ke Bao authored Oct 07, 2025
```
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  24bc3fb0
- [ci] fix pp test (#11294) · 8a8a608a
  Liangsheng Yin authored Oct 07, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  8a8a608a
- Feature/longbench v2 evaluation utils (#10949) · 533e58a1
  Al-Ekram Elahee Hridoy authored Oct 07, 2025
  
  533e58a1
- convert test_deterministic into unit tests (#11095) · 9b4c4497
  Alex Chi Z authored Oct 07, 2025
```
Signed-off-by: Alex Chi Z <iskyzh@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  9b4c4497
- [router][grpc] Fix proto3 default value mismatches and cleanup unused fields (#11283) · a578d300
  Chang Su authored Oct 06, 2025
  
  a578d300
- chore: bump sgl-kernel version to 0.3.15 (#11281) · 8c967037
  sglang-bot authored Oct 06, 2025
  
  8c967037
- docs: update sgl-kernel README (#11286) · fb27d383
  Yineng Zhang authored Oct 06, 2025
  
  fb27d383
- fix: correct scale parameter remapping logic in Llama4ForConditionalGeneration (#11282) · fd8a0b29
  Xinyuan Tong authored Oct 06, 2025
  
  fd8a0b29
- Fix LoRA support for multimodal models (VLMs) by implementing a consistent... · afc35ccc
  Chenxi Li authored Oct 06, 2025
```
Fix LoRA support for multimodal models (VLMs) by implementing a consistent pattern for skipping vision components (#11261)
```
  afc35ccc
06 Oct, 2025 23 commits
- reverse the amd ci test back to 1200s and split the 8-gpu deepseek job into two. (#11238) · a57f0e3d
  sunxxuns authored Oct 06, 2025
```
Co-authored-by: root <root@smci350-zts-gtu-e17-15.zts-gtu.dcgpu>
```
  a57f0e3d
- Rename max_micro_batch_size -> pp_max_micro_batch_size (#11279) · 708f4ff4
  Lianmin Zheng authored Oct 06, 2025
  
  708f4ff4
- [Auto Sync] Update test_utils.py (20251006) (#11280) · e2daeb35
  Lianmin Zheng authored Oct 06, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  e2daeb35
- Fix code sync scripts (#11276) · 0e7b3530
  Lianmin Zheng authored Oct 06, 2025
  
  0e7b3530
- [router][grpc] Refine streaming processes (#11277) · b07c9c76
  Chang Su authored Oct 06, 2025
  
  b07c9c76
- [Bug] Fix incorrect assertion in FA4 and add UT. (#11182) · 748f86f3
  Lifu Huang authored Oct 06, 2025
  
  748f86f3
- docker: add manifest to versioned docker releases (#11268) · 73ea484a
  ishandhanani authored Oct 06, 2025
  
  73ea484a
- disable sm100 for FlashMLA and fast-hadamard-transform in cuda12.6.1 (#11274) · 4aeb193f
  gongwei-130 authored Oct 06, 2025
  
  4aeb193f
- [router][tool call] Clean up redundant `detect_format` and `has_tool_markers` (#11270) · 466992b2
  Chang Su authored Oct 06, 2025
  
  466992b2
- Enable native ModelOpt quantization support (1/3) (#7149) · 155cbb51
  Zhiyu authored Oct 06, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  155cbb51
- Remove env var warnings for release (#11262) · eb30b888
  Lianmin Zheng authored Oct 06, 2025
  
  eb30b888
- [router] add ipv6 support across all components (#11219) · 5ee777c9
  Simo Lin authored Oct 06, 2025
  
  5ee777c9
- chore: bump SGLang version to 0.5.3 (#11263) · a4a3d823
  sglang-bot authored Oct 06, 2025
  
  a4a3d823
- chore: bump SGLang version to 0.5.3rc2 (#11259) · 0b13cbb7
  sglang-bot authored Oct 06, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  0b13cbb7
- Support DeepSeek V3.2 Exp (#11061) · efbc687c
  fzyzcjy authored Oct 06, 2025
```
Co-authored-by: Stefan He <11166516+hebiao064@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <95566987+hnyls2002@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <56809903+fridge003@users.noreply.github.com>
Co-authored-by: DarkSharpness <76582120+darksharpness@users.noreply.github.com>
Co-authored-by: ZhengdQin <46387172+zhengdqin@users.noreply.github.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Zhengda Qin <zhengdqin@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  efbc687c
- Add flashmla and fast hadamard transform to Dockerfile (#11235) · 292a867a
  Baizhou Zhang authored Oct 05, 2025
  
  292a867a
- Improve bot release workflow (#11240) · 8fd41eae
  Kangyan-Zhou authored Oct 05, 2025
  
  8fd41eae
- feat: add shortcut detection for multimodal templates in Jinja format (#11209) · 0cd1996e
  Xinyuan Tong authored Oct 05, 2025
  
  0cd1996e
- Update condition for sgl-kernel-benchmark-test (#11254) · b6b4b563
  Lianmin Zheng authored Oct 05, 2025
  
  b6b4b563
- update sgl kernel version to 0.3.14.post1 (#11242) · f8924ad7
  Lianmin Zheng authored Oct 05, 2025
  
  f8924ad7
- Bump torch_memory_saver 0.0.9rc2 (#11252) · 2f80bd9f
  fzyzcjy authored Oct 06, 2025
  
  2f80bd9f
- Use cu128 for torch audio to fix some CI tests (#11251) · 366a603e
  Lianmin Zheng authored Oct 05, 2025
  
  366a603e
- [quantization] Enable aiter mxfp4 fused_moe for Quark (#10048) · baee0860
  Bowen Bao authored Oct 05, 2025
```
Co-authored-by: HaiShaw <hixiao@gmail.com>
```
  baee0860