Commits · 0b2aa8a70ca503abbde4905cf0f857933fbdc928 · change / sglang · GitLab

02 Oct, 2025 1 commit
- Intoduce cpu tensor as metadata to avoid blocking gpu kernel launch (#10720) · 0b2aa8a7
  Zhang Junda authored Oct 02, 2025
```
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
```
  0b2aa8a7
01 Oct, 2025 17 commits
- Remove debug print statement from scheduler output (#11145) · 609f65ba
  Lianmin Zheng authored Oct 01, 2025
  
  609f65ba
- Fix metrics and request tracing (TimeStats) (#11123) · 2d62af6b
  Lianmin Zheng authored Oct 01, 2025
  
  2d62af6b
- [router] Add multi-turn tool calling loop support for MCP integration (#11143) · a28b394f
  Keyang Ru authored Oct 01, 2025
  
  a28b394f
- [router] add pd service in grpc router for pd (#11120) · 96fe2d0f
  Simo Lin authored Oct 01, 2025
  
  96fe2d0f
- [HiCache] Configurable and Dynamic Prefetch Timeout (#10512) · bfa27438
  ykwd authored Oct 01, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  bfa27438
- [Feature] Add EIC as sglang HiCache Storage backend (#10271) · 86cb4db0
  Shisong Ma authored Oct 01, 2025
```
Co-authored-by: mashisong <mashisong@bytedance.com>
```
  86cb4db0
- [HiCache]bug fix: fixed blank item in host_mem_release_queue (#11005) · 2e130b76
  zhangzuo21 authored Oct 01, 2025
```
Co-authored-by: Zuoyuan Zhang <zuoyuanzhang@ZuoyuandeMacBook-Pro.local>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  2e130b76
- feat: add fast_decode_plan from flashinfer, flashinfer to 0.4.0rc3 (#10760) · ac1f2928
  eigen authored Oct 01, 2025
```
Co-authored-by: Zihao Ye <yezihhhao@gmail.com>
Co-authored-by: Sleepcoo <Sleepcoo@gmail.com>
```
  ac1f2928
- Refactor AMD CI. (#11128) · 195a59fe
  Sai Enduri authored Oct 01, 2025
  
  195a59fe
- docker: x86 dev builds for hopper and blackwell (#11075) · 47488cc3
  ishandhanani authored Oct 01, 2025
  
  47488cc3
- Quick Fix: fix Qwen3-VL launch failure caused by MRotaryEmbedding arg (#10985) · 61305291
  yhyang201 authored Oct 01, 2025
  
  61305291
- [Doc] Update multimodal language models documentation (#11111) · a9ce2bcb
  Xinyuan Tong authored Sep 30, 2025
```
Co-authored-by: Mick <mickjagger19@icloud.com>
```
  a9ce2bcb
- [Auto Sync] Update base_grammar_backend.py, xgrammar_backen... (20250930) (#11115) · 5dddb331
  Lianmin Zheng authored Sep 30, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  5dddb331
- [AMD] Add Tilelang and Fast Hadamard Transform builds to Dockerfile.rocm (#11114) · 01a26544
  Hubert Lu authored Sep 30, 2025
  
  01a26544
- Organize spec-related data structures (#10735) · 73d4a5f8
  Liangsheng Yin authored Oct 01, 2025
  
  73d4a5f8
- [router] add mcp list and mcp call in output array (#11112) · 7fb551a7
  Keyang Ru authored Sep 30, 2025
  
  7fb551a7
- fix: KimiK2Detector Improve tool call ID parsing with regex (#10972) · 1193f131
  Xinyuan Tong authored Sep 30, 2025
  
  1193f131
30 Sep, 2025 19 commits
- Feature/make PEFT adapter module format compatibile (#11080) · 84a9f5d6
  Chenxi Li authored Sep 30, 2025
  
  84a9f5d6
- [router][bugfix] Fix input_logprobs handling with None value and `logprob_start_len = -1` (#11113) · 8ce830a8
  Chang Su authored Sep 30, 2025
  
  8ce830a8
- Support Dots.ocr model (#11071) · fb367acf
  qrskannbara authored Oct 01, 2025
  
  fb367acf
- Fix DSR1 accuracy for flashinfer_trtllm MoE with FP8 quantization (#11081) · a6cc86df
  Trevor Morris authored Sep 30, 2025
  
  a6cc86df
- [CPU] Adding Memory Capacity Acquisition Functionality (#11102) · 229d2b95
  Zaili Wang authored Sep 30, 2025
  
  229d2b95
- [Eval] Add `--repeat` in `run_eval` (#11101) · 9710f718
  Liangsheng Yin authored Sep 30, 2025
  
  9710f718
- Fix eagle radix cache (#10846) · 91847e38
  Ke Bao authored Sep 30, 2025
  
  91847e38
- [router][grpc-server] Fix gRPC server shutdown (#11094) · 5a290a56
  Simo Lin authored Sep 30, 2025
  
  5a290a56
- chore: bump sgl-kernel v0.3.14 (#11067) · 580051c5
  PGFLMG authored Sep 30, 2025
  
  580051c5
- [Auto Sync] Update fused_moe_triton_config.py (20250930) (#11099) · 1237aa19
  Lianmin Zheng authored Sep 30, 2025
```
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
```
  1237aa19
- [Fix] Resolve performance drop in speculative decoding aiter backend (#11087) · 59911195
  jacky.cheng authored Sep 30, 2025
  
  59911195
- Fix spec filter batch when target extend (#10991) · 424591d5
  Ke Bao authored Sep 30, 2025
  
  424591d5
- [router][tool call] Full support for ToolChoice (#11085) · d1676cd4
  Chang Su authored Sep 29, 2025
```
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
```
  d1676cd4
- [router] grpc router generate endpoint support (#11070) · 33b3c0f8
  Simo Lin authored Sep 30, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  33b3c0f8
- Update CODEOWNERS for attention/ascend_backend.py (#11092) · e5281f84
  Lianmin Zheng authored Sep 29, 2025
  
  e5281f84
- Enable optional FP32 compute for LM Head (#10729) · d17986f8
  narutolhy authored Sep 29, 2025
```
Thanks to MiniMax Team and Chenyang Zhao's support.
```
  d17986f8
- [model] added support for w8a8int8 used by neuralmagic/Qwen2-0.5B-Ins… (#9642) · 8831c55c
  DevashishLal-CB authored Sep 29, 2025
  
  8831c55c
- Remove hybrid_linear_attn attention backend and refactor attention registry (#10816) · 2bc61dd1
  li-kesen authored Sep 30, 2025
```
Co-authored-by: Yi Zhang <1109276519@qq.com>
```
  2bc61dd1
- [Profile] dump memory trace when cuda graph profile is enabled (#11083) · 6535fda1
  Cheng Wan authored Sep 29, 2025
  
  6535fda1
29 Sep, 2025 3 commits
- feat(reasoning): improve enable thinking from request (#10875) · 3713eb61
  Jimmy authored Sep 30, 2025
  
  3713eb61
- [router][grpc] Add logprobs support to router (#11082) · 5937a56d
  Chang Su authored Sep 29, 2025
  
  5937a56d
- [router] Use `get_pooled` in `process_single_choice` (#11079) · f065e5be
  Chang Su authored Sep 29, 2025
  
  f065e5be