Commits · 4ed67c27e39523225e1b01524be7eaa53d3a7773 · change / sglang

"examples/community/latent_consistency_interpolate.py" did not exist on "493f9529d75b868da58bb16f711ed39c73f39b8c"

07 Oct, 2025 25 commits
- [router] support Openai router conversation API CRUD (#11297) · 4ed67c27
  Keyang Ru authored Oct 07, 2025
  
  4ed67c27
- [quantization] Properly ignore quantization for layers excluded in quant_config (#11205) · cd4b39a9
  Bowen Bao authored Oct 07, 2025
  
  cd4b39a9
- [router][grpc] Fix error message format in grpc chat handler (#11307) · 420c99ac
  Chang Su authored Oct 07, 2025
  
  420c99ac
- Update tool parser and related documentation (#11223) · e3c7f091
  Xinyuan Tong authored Oct 07, 2025
  
  e3c7f091
- [router][grpc] Fix sampling_params.stop_strs is None (#11306) · 6f1e03a4
  Chang Su authored Oct 07, 2025
  
  6f1e03a4
- [router] fix grpc connection conversion and add optimization (#11305) · f4affd4d
  Simo Lin authored Oct 07, 2025
  
  f4affd4d
- [Doc]: Best Practice for HICache (#11001) · df08bf9b
  hzh0425 authored Oct 08, 2025
```
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  df08bf9b
- [Doc] HiCache Design Documents (#11027) · 69efdd27
  ykwd authored Oct 08, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  69efdd27
- [router][grpc] Refactor chat template content format detection (#11288) · 64582caa
  Chang Su authored Oct 07, 2025
  
  64582caa
- [router] add get server info and get model info in grpc server (#11303) · 2fcd56ea
  Simo Lin authored Oct 07, 2025
  
  2fcd56ea
- [Docs] [Router] Update Observability and Common Issues Section (#11302) · 0958a397
  Wenyi Xu authored Oct 07, 2025
  
  0958a397
- [sgl-kernel] Support float64 moe_sum_reduce cuda kernel (#11068) · 4f42c8cd
  Yuan Luo authored Oct 07, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  4f42c8cd
- Introduce future indices (#11301) · 3ddd7dc9
  Liangsheng Yin authored Oct 07, 2025
  
  3ddd7dc9
- Remove sampling info events and overlap thread file (#11300) · 501dfa6b
  Liangsheng Yin authored Oct 07, 2025
  
  501dfa6b
- [router] add reasoning and tool parser argument in router (#11290) · 79d34951
  Simo Lin authored Oct 07, 2025
  
  79d34951
- Remove overlap thread (#11210) · 1519a89c
  Liangsheng Yin authored Oct 07, 2025
```
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  1519a89c
- EAGLE cache fix for SWARadixCache (#11231) · 24bc3fb0
  Ke Bao authored Oct 07, 2025
```
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  24bc3fb0
- [ci] fix pp test (#11294) · 8a8a608a
  Liangsheng Yin authored Oct 07, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  8a8a608a
- Feature/longbench v2 evaluation utils (#10949) · 533e58a1
  Al-Ekram Elahee Hridoy authored Oct 07, 2025
  
  533e58a1
- convert test_deterministic into unit tests (#11095) · 9b4c4497
  Alex Chi Z authored Oct 07, 2025
```
Signed-off-by: Alex Chi Z <iskyzh@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  9b4c4497
- [router][grpc] Fix proto3 default value mismatches and cleanup unused fields (#11283) · a578d300
  Chang Su authored Oct 06, 2025
  
  a578d300
- chore: bump sgl-kernel version to 0.3.15 (#11281) · 8c967037
  sglang-bot authored Oct 06, 2025
  
  8c967037
- docs: update sgl-kernel README (#11286) · fb27d383
  Yineng Zhang authored Oct 06, 2025
  
  fb27d383
- fix: correct scale parameter remapping logic in Llama4ForConditionalGeneration (#11282) · fd8a0b29
  Xinyuan Tong authored Oct 06, 2025
  
  fd8a0b29
- Fix LoRA support for multimodal models (VLMs) by implementing a consistent... · afc35ccc
  Chenxi Li authored Oct 06, 2025
```
Fix LoRA support for multimodal models (VLMs) by implementing a consistent pattern for skipping vision components (#11261)
```
  afc35ccc
06 Oct, 2025 15 commits
- reverse the amd ci test back to 1200s and split the 8-gpu deepseek job into two. (#11238) · a57f0e3d
  sunxxuns authored Oct 06, 2025
```
Co-authored-by: root <root@smci350-zts-gtu-e17-15.zts-gtu.dcgpu>
```
  a57f0e3d
- Rename max_micro_batch_size -> pp_max_micro_batch_size (#11279) · 708f4ff4
  Lianmin Zheng authored Oct 06, 2025
  
  708f4ff4
- [Auto Sync] Update test_utils.py (20251006) (#11280) · e2daeb35
  Lianmin Zheng authored Oct 06, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  e2daeb35
- Fix code sync scripts (#11276) · 0e7b3530
  Lianmin Zheng authored Oct 06, 2025
  
  0e7b3530
- [router][grpc] Refine streaming processes (#11277) · b07c9c76
  Chang Su authored Oct 06, 2025
  
  b07c9c76
- [Bug] Fix incorrect assertion in FA4 and add UT. (#11182) · 748f86f3
  Lifu Huang authored Oct 06, 2025
  
  748f86f3
- docker: add manifest to versioned docker releases (#11268) · 73ea484a
  ishandhanani authored Oct 06, 2025
  
  73ea484a
- disable sm100 for FlashMLA and fast-hadamard-transform in cuda12.6.1 (#11274) · 4aeb193f
  gongwei-130 authored Oct 06, 2025
  
  4aeb193f
- [router][tool call] Clean up redundant `detect_format` and `has_tool_markers` (#11270) · 466992b2
  Chang Su authored Oct 06, 2025
  
  466992b2
- Enable native ModelOpt quantization support (1/3) (#7149) · 155cbb51
  Zhiyu authored Oct 06, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  155cbb51
- Remove env var warnings for release (#11262) · eb30b888
  Lianmin Zheng authored Oct 06, 2025
  
  eb30b888
- [router] add ipv6 support across all components (#11219) · 5ee777c9
  Simo Lin authored Oct 06, 2025
  
  5ee777c9
- chore: bump SGLang version to 0.5.3 (#11263) · a4a3d823
  sglang-bot authored Oct 06, 2025
  
  a4a3d823
- chore: bump SGLang version to 0.5.3rc2 (#11259) · 0b13cbb7
  sglang-bot authored Oct 06, 2025
```
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
```
  0b13cbb7
- Support DeepSeek V3.2 Exp (#11061) · efbc687c
  fzyzcjy authored Oct 06, 2025
```
Co-authored-by: Stefan He <11166516+hebiao064@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <95566987+hnyls2002@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <56809903+fridge003@users.noreply.github.com>
Co-authored-by: DarkSharpness <76582120+darksharpness@users.noreply.github.com>
Co-authored-by: ZhengdQin <46387172+zhengdqin@users.noreply.github.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Zhengda Qin <zhengdqin@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  efbc687c