Commits · b5dcfd4154262307cbaf595522acf445bd4c482c · change / sglang

"vscode:/vscode.git/clone" did not exist on "4d641f7f56d4da78303c5a55846baa97d6505c86"

11 Oct, 2025 20 commits
- Add option to disable `any_whitespace` for `xgrammar` and `llguidance` backends. (#8919) · b5dcfd41
  Lorenzo Lu authored Oct 11, 2025
```
Co-authored-by: Chang Su <chang.s.su@oracle.com>
```
  b5dcfd41
- fix stop when stream (#11462) · 5061b8fd
  ybyang authored Oct 11, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
```
  5061b8fd
- [Fix] Fix split prefill with fa3. (#11428) · c8452551
  ykcombat authored Oct 11, 2025
  
  c8452551
- Fix enable_v2 in int8 quant (#11470) · bf3e7149
  fzyzcjy authored Oct 11, 2025
  
  bf3e7149
- [Documentation][Configuration] Server args and documentation of PD-Multiplexing. (#11427) · f5754d12
  ykcombat authored Oct 11, 2025
  
  f5754d12
- Adjust logits metada init for target verify (#11467) · 739daa63
  Liangsheng Yin authored Oct 11, 2025
  
  739daa63
- Super tiny delete unused openai router in sgl-router (#11448) · d957177a
  fzyzcjy authored Oct 11, 2025
  
  d957177a
- Reland [1/2] Optimizations and refactors about quant kernel (#10312) · 21337b22
  fzyzcjy authored Oct 11, 2025
```
Co-authored-by: Yineng Zhang <me@zhyncs.com>
```
  21337b22
- Enable native ModelOpt quantization support (2/3) (#9991) · 129d2992
  Zhiyu authored Oct 11, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  129d2992
- Remove tilelang dependency in Dockerfile (#11455) · 8b85926a
  Baizhou Zhang authored Oct 10, 2025
  
  8b85926a
- [DPSKv3.2] Rewrite nsa tilelang act_quant kernel to triton (#11450) · 451d15c4
  Binyao Jiang authored Oct 10, 2025
  
  451d15c4
- [BugFix] test_mla_fp8.py fails on Cublas 12.9 (#11360) · c80a96da
  Liu-congo authored Oct 11, 2025
```
Signed-off-by: Liu-congo <1502632128@qq.com>
```
  c80a96da
- Fix batch invariant ops (#11368) · eae9a9fb
  Stefan He authored Oct 10, 2025
  
  eae9a9fb
- fix: Change dsv32 hack temporary path to use system temp directory (#11445) · 2674c1d2
  wxsm authored Oct 11, 2025
  
  2674c1d2
- Reorder PD disagg CI tests (#11438) · 61055cb3
  Lianmin Zheng authored Oct 10, 2025
  
  61055cb3
- [router][grpc] Consolidate parser checks for chat completions (#11439) · 92777135
  Chang Su authored Oct 10, 2025
  
  92777135
- [router] leverage RAII to actively cancel request during client disconnect (#11399) · c4958331
  Simo Lin authored Oct 10, 2025
  
  c4958331
- [router] disable rate limiter by default (#11435) · 2eeb2751
  Simo Lin authored Oct 10, 2025
  
  2eeb2751
- Separate allocation logic from scheduler (#11313) · b36afed4
  cctry authored Oct 10, 2025
  
  b36afed4
- feat(mooncake): support GB suffix for global_segment_size (#10745) · 9aa4502d
  JinYan Su authored Oct 11, 2025
```
Signed-off-by: Jinyang Su <751080330@qq.com>
Co-authored-by: huangtingwei <141888744+huangtingwei9988@users.noreply.github.com>
```
  9aa4502d
10 Oct, 2025 19 commits
- [router] Fix ci nvcc not found error (#11411) · a0835c3a
  Keyang Ru authored Oct 10, 2025
  
  a0835c3a
- Revert "Add metrics for speculative decoding (acceptance rate, average acceptance length)" (#11433) · 55b14656
  Scott Lee authored Oct 10, 2025
  
  55b14656
- Revert "fix: fix video input for qwen3-vl" (#11437) · b4408e60
  Lianmin Zheng authored Oct 10, 2025
  
  b4408e60
- Revert "perf: optimize qwen-vl with symm mem allreduce" (#11436) · 52fcbbb8
  Cheng Wan authored Oct 10, 2025
  
  52fcbbb8
- [CI] Merge build-dev into workflow matrix (#11345) · af96ca11
  Sahithi Chigurupati authored Oct 10, 2025
```
Signed-off-by: Sahithi Chigurupati <chigurupati.sahithi@gmail.com>
```
  af96ca11
- [HiCache] feat: add multi tenant with prefix tag (#9256) · 9082a7d3
  Teng Ma authored Oct 11, 2025
  
  9082a7d3
- perf: optimize qwen-vl with symm mem allreduce (#11381) · 3b9d97f3
  Yuan Luo authored Oct 10, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  3b9d97f3
- fix: fix video input for qwen3-vl (#11361) · a1a20b4c
  Mick authored Oct 10, 2025
  
  a1a20b4c
- chore: update pyproject (#11420) · 4299aebd
  Yineng Zhang authored Oct 10, 2025
  
  4299aebd
- Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11144) · 0babd487
  Scott Lee authored Oct 10, 2025
  
  0babd487
- Dedicated toml files for CPU/XPU (#10734) · f19613e6
  Zaili Wang authored Oct 10, 2025
  
  f19613e6
- fix file and object naming scheme in HiCacheNixl to avoid data corruption (#10969) · 8df49455
  ziruiliu authored Oct 10, 2025
```
Signed-off-by: Zirui Liu <ziliu@ddn.com>
```
  8df49455
- feat(hicache): Support passing prefix keys for l3 store. (#9045) · ee3bd8a1
  hzh0425 authored Oct 10, 2025
```
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  ee3bd8a1
- fix: reinstall torch in deps install (#11414) · d8467db7
  Yineng Zhang authored Oct 09, 2025
  
  d8467db7
- Replace pad with cat for better performance (#11388) · b5044fbf
  Yuan Luo authored Oct 10, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  b5044fbf
- [CI] Refactor PD disaggregation test suite (#11363) · 70fbb3ad
  Shangming Cai authored Oct 10, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  70fbb3ad
- [Bug Fix] prevent lora adapter from being loaded into LoRAManager if it is already loaded (#11365) · 9a7e7a65
  Glen Liu authored Oct 09, 2025
  
  9a7e7a65
- fix: fix gpu-proc affinity set incorrectly when pp_size > 1 (#11389) · 0fe87213
  Yingchun Lai authored Oct 10, 2025
  
  0fe87213
- [grammar] Avoid server crash when grammar backend is None (#11401) · 1f106ee3
  Xinyuan Tong authored Oct 09, 2025
  
  1f106ee3
09 Oct, 2025 1 commit
- move more files under srt/utils (#11285) · 9b8ebb27
  Lianmin Zheng authored Oct 09, 2025
  
  9b8ebb27