Commits · c4d77774e187ca21355b2a1c7eb7fd25421adac7 · change / sglang · GitLab

08 Oct, 2025 5 commits
- update sampling_params documentation with defaults (#11315) · c4d77774
  Xinyuan Tong authored Oct 07, 2025
  
  c4d77774
- [Chore] Update xgrammar 0.1.24 -> 0.1.25 (#10710) · 832c84fb
  DarkSharpness authored Oct 08, 2025
  
  832c84fb
- ci: unify the model launch method of nightly ci (#11230) · 64d1505c
  Mick authored Oct 08, 2025
  
  64d1505c
- Clean match_prefix and prepare_for_extend for mem cache V2 (#11200) · f3764c26
  cctry authored Oct 07, 2025
  
  f3764c26
- [oai serving chat] Add argument `--sampling-defaults` and fix... · 7ba3de0e
  Chang Su authored Oct 07, 2025
```
[oai serving chat] Add argument `--sampling-defaults` and fix `ChatCompletionRequest` defaults (#11304)
```
  7ba3de0e
07 Oct, 2025 27 commits
- [router] cleanup worker health check to return early (#11310) · fde9b963
  Simo Lin authored Oct 07, 2025
  
  fde9b963
- [router][grpc] Fix request_id extraction when n > 1 (#11311) · f094e0a4
  Chang Su authored Oct 07, 2025
  
  f094e0a4
- [router] support Openai router conversation API CRUD (#11297) · 4ed67c27
  Keyang Ru authored Oct 07, 2025
  
  4ed67c27
- [quantization] Properly ignore quantization for layers excluded in quant_config (#11205) · cd4b39a9
  Bowen Bao authored Oct 07, 2025
  
  cd4b39a9
- [router][grpc] Fix error message format in grpc chat handler (#11307) · 420c99ac
  Chang Su authored Oct 07, 2025
  
  420c99ac
- Update tool parser and related documentation (#11223) · e3c7f091
  Xinyuan Tong authored Oct 07, 2025
  
  e3c7f091
- [router][grpc] Fix sampling_params.stop_strs is None (#11306) · 6f1e03a4
  Chang Su authored Oct 07, 2025
  
  6f1e03a4
- [router] fix grpc connection conversion and add optimization (#11305) · f4affd4d
  Simo Lin authored Oct 07, 2025
  
  f4affd4d
- [Doc]: Best Practice for HICache (#11001) · df08bf9b
  hzh0425 authored Oct 08, 2025
```
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  df08bf9b
- [Doc] HiCache Design Documents (#11027) · 69efdd27
  ykwd authored Oct 08, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  69efdd27
- [router][grpc] Refactor chat template content format detection (#11288) · 64582caa
  Chang Su authored Oct 07, 2025
  
  64582caa
- [router] add get server info and get model info in grpc server (#11303) · 2fcd56ea
  Simo Lin authored Oct 07, 2025
  
  2fcd56ea
- [Docs] [Router] Update Observability and Common Issues Section (#11302) · 0958a397
  Wenyi Xu authored Oct 07, 2025
  
  0958a397
- [sgl-kernel] Support float64 moe_sum_reduce cuda kernel (#11068) · 4f42c8cd
  Yuan Luo authored Oct 07, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  4f42c8cd
- Introduce future indices (#11301) · 3ddd7dc9
  Liangsheng Yin authored Oct 07, 2025
  
  3ddd7dc9
- Remove sampling info events and overlap thread file (#11300) · 501dfa6b
  Liangsheng Yin authored Oct 07, 2025
  
  501dfa6b
- [router] add reasoning and tool parser argument in router (#11290) · 79d34951
  Simo Lin authored Oct 07, 2025
  
  79d34951
- Remove overlap thread (#11210) · 1519a89c
  Liangsheng Yin authored Oct 07, 2025
```
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  1519a89c
- EAGLE cache fix for SWARadixCache (#11231) · 24bc3fb0
  Ke Bao authored Oct 07, 2025
```
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  24bc3fb0
- [ci] fix pp test (#11294) · 8a8a608a
  Liangsheng Yin authored Oct 07, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  8a8a608a
- Feature/longbench v2 evaluation utils (#10949) · 533e58a1
  Al-Ekram Elahee Hridoy authored Oct 07, 2025
  
  533e58a1
- convert test_deterministic into unit tests (#11095) · 9b4c4497
  Alex Chi Z authored Oct 07, 2025
```
Signed-off-by: Alex Chi Z <iskyzh@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
```
  9b4c4497
- [router][grpc] Fix proto3 default value mismatches and cleanup unused fields (#11283) · a578d300
  Chang Su authored Oct 06, 2025
  
  a578d300
- chore: bump sgl-kernel version to 0.3.15 (#11281) · 8c967037
  sglang-bot authored Oct 06, 2025
  
  8c967037
- docs: update sgl-kernel README (#11286) · fb27d383
  Yineng Zhang authored Oct 06, 2025
  
  fb27d383
- fix: correct scale parameter remapping logic in Llama4ForConditionalGeneration (#11282) · fd8a0b29
  Xinyuan Tong authored Oct 06, 2025
  
  fd8a0b29
- Fix LoRA support for multimodal models (VLMs) by implementing a consistent... · afc35ccc
  Chenxi Li authored Oct 06, 2025
```
Fix LoRA support for multimodal models (VLMs) by implementing a consistent pattern for skipping vision components (#11261)
```
  afc35ccc
06 Oct, 2025 8 commits
- reverse the amd ci test back to 1200s and split the 8-gpu deepseek job into two. (#11238) · a57f0e3d
  sunxxuns authored Oct 06, 2025
```
Co-authored-by: root <root@smci350-zts-gtu-e17-15.zts-gtu.dcgpu>
```
  a57f0e3d
- Rename max_micro_batch_size -> pp_max_micro_batch_size (#11279) · 708f4ff4
  Lianmin Zheng authored Oct 06, 2025
  
  708f4ff4
- [Auto Sync] Update test_utils.py (20251006) (#11280) · e2daeb35
  Lianmin Zheng authored Oct 06, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  e2daeb35
- Fix code sync scripts (#11276) · 0e7b3530
  Lianmin Zheng authored Oct 06, 2025
  
  0e7b3530
- [router][grpc] Refine streaming processes (#11277) · b07c9c76
  Chang Su authored Oct 06, 2025
  
  b07c9c76
- [Bug] Fix incorrect assertion in FA4 and add UT. (#11182) · 748f86f3
  Lifu Huang authored Oct 06, 2025
  
  748f86f3
- docker: add manifest to versioned docker releases (#11268) · 73ea484a
  ishandhanani authored Oct 06, 2025
  
  73ea484a
- disable sm100 for FlashMLA and fast-hadamard-transform in cuda12.6.1 (#11274) · 4aeb193f
  gongwei-130 authored Oct 06, 2025
  
  4aeb193f