Commits · f4aa78801e683dbd71a13e6360d44b2ac3748930 · change / sglang · GitLab

13 Oct, 2025 4 commits
- Adjust overlap event loop (#11507) · bfadb5ea
  Liangsheng Yin authored Oct 14, 2025
  
  bfadb5ea
- Depreate `global_server_args_dict` (#11528) · 516738b0
  Liangsheng Yin authored Oct 13, 2025
  
  516738b0
- [Feature] Support mamba radix cache v0 (#11214) · a55cf530
  Yi Zhang authored Oct 13, 2025
```
Co-authored-by: hanming-lu <hanming@x.ai>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: thalahors <ericalcaide1@gmail.com>
```
  a55cf530
- Revert "Deprecate `global_server_args_dict`" (#11520) · 1bdd0102
  Cheng Wan authored Oct 12, 2025
  
  1bdd0102
12 Oct, 2025 4 commits
- Deprecate `global_server_args_dict` (#11331) · 1083e7e3
  Liangsheng Yin authored Oct 13, 2025
  
  1083e7e3
- Move args from `global_config` to `environ` (#11332) · f4941906
  Liangsheng Yin authored Oct 12, 2025
  
  f4941906
- Beta spec-overlap for EAGLE (#11398) · 20a6c0a6
  Liangsheng Yin authored Oct 12, 2025
```
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  20a6c0a6
- [Feature] support regex strings as a stopping condition (#10635) · 47c606d3
  Glen Liu authored Oct 11, 2025
  
  47c606d3
11 Oct, 2025 2 commits
- fix stop when stream (#11462) · 5061b8fd
  ybyang authored Oct 11, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
```
  5061b8fd
- Separate allocation logic from scheduler (#11313) · b36afed4
  cctry authored Oct 10, 2025
  
  b36afed4
10 Oct, 2025 4 commits
- Revert "Add metrics for speculative decoding (acceptance rate, average acceptance length)" (#11433) · 55b14656
  Scott Lee authored Oct 10, 2025
  
  55b14656
- Revert "perf: optimize qwen-vl with symm mem allreduce" (#11436) · 52fcbbb8
  Cheng Wan authored Oct 10, 2025
  
  52fcbbb8
- perf: optimize qwen-vl with symm mem allreduce (#11381) · 3b9d97f3
  Yuan Luo authored Oct 10, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  3b9d97f3
- Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11144) · 0babd487
  Scott Lee authored Oct 10, 2025
  
  0babd487
09 Oct, 2025 1 commit
- [Generative Score API] Multi-Item scoring with custom attention mask. (#10979) · 53bd00d9
  Sundara Raman Ramachandran authored Oct 08, 2025
  
  53bd00d9
08 Oct, 2025 1 commit
- Clean match_prefix and prepare_for_extend for mem cache V2 (#11200) · f3764c26
  cctry authored Oct 07, 2025
  
  f3764c26
07 Oct, 2025 2 commits
- Remove sampling info events and overlap thread file (#11300) · 501dfa6b
  Liangsheng Yin authored Oct 07, 2025
  
  501dfa6b
- Remove overlap thread (#11210) · 1519a89c
  Liangsheng Yin authored Oct 07, 2025
```
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  1519a89c
06 Oct, 2025 2 commits

Rename max_micro_batch_size -> pp_max_micro_batch_size (#11279) · 708f4ff4
Lianmin Zheng authored Oct 06, 2025

708f4ff4

Support DeepSeek V3.2 Exp (#11061) · efbc687c

fzyzcjy authored Oct 06, 2025


Co-authored-by: Stefan He <11166516+hebiao064@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <95566987+hnyls2002@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <56809903+fridge003@users.noreply.github.com>
Co-authored-by: DarkSharpness <76582120+darksharpness@users.noreply.github.com>
Co-authored-by: ZhengdQin <46387172+zhengdqin@users.noreply.github.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Zhengda Qin <zhengdqin@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

efbc687c

05 Oct, 2025 1 commit
- Tiny `skip_sample` adjust (#11225) · 4cb5a523
  Liangsheng Yin authored Oct 05, 2025
  
  4cb5a523
02 Oct, 2025 3 commits
- Unify forward output datastructure (#11124) · 458611de
  Liangsheng Yin authored Oct 03, 2025
  
  458611de
- Fix ngram spec with page size > 1 (#11135) · 25e7dbe8
  Liangsheng Yin authored Oct 02, 2025
  
  25e7dbe8
- Intoduce cpu tensor as metadata to avoid blocking gpu kernel launch (#10720) · 0b2aa8a7
  Zhang Junda authored Oct 02, 2025
```
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
```
  0b2aa8a7
01 Oct, 2025 2 commits
- Fix metrics and request tracing (TimeStats) (#11123) · 2d62af6b
  Lianmin Zheng authored Oct 01, 2025
  
  2d62af6b
- Organize spec-related data structures (#10735) · 73d4a5f8
  Liangsheng Yin authored Oct 01, 2025
  
  73d4a5f8
30 Sep, 2025 3 commits
- Fix eagle radix cache (#10846) · 91847e38
  Ke Bao authored Sep 30, 2025
  
  91847e38
- Fix spec filter batch when target extend (#10991) · 424591d5
  Ke Bao authored Sep 30, 2025
  
  424591d5
- Enable optional FP32 compute for LM Head (#10729) · d17986f8
  narutolhy authored Sep 29, 2025
```
Thanks to MiniMax Team and Chenyang Zhao's support.
```
  d17986f8
29 Sep, 2025 2 commits
- Fix mem fraction static for nightly tests (#11076) · dda34c2f
  Lianmin Zheng authored Sep 29, 2025
  
  dda34c2f
- [speculative decoding] rename lookahead to ngram (#11010) · 24f7cb1e
  Zhihao Zhang authored Sep 29, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
```
  24f7cb1e
27 Sep, 2025 1 commit
- Add support for topk metadata transferring for PD (#10616) · e23e280e
  Shangming Cai authored Sep 28, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  e23e280e
24 Sep, 2025 1 commit
- feat: add cache_salt support to request (#10718) · 71f24ef8
  Xinyuan Tong authored Sep 23, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  71f24ef8
22 Sep, 2025 1 commit
- [2/2] Support deterministic inference for temperature > 0 (#10678) · e2ac7888
  Qiaolin Yu authored Sep 21, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
```
  e2ac7888
21 Sep, 2025 1 commit
- Refactors radix cache for extra key support (#10317) · 12d6cf18
  Xinyuan Tong authored Sep 21, 2025
```
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
```
  12d6cf18
20 Sep, 2025 1 commit
- [1/2] Support deterministic inference with flashinfer attention backend (#10645) · 8ecef73f
  Baizhou Zhang authored Sep 19, 2025
```
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  8ecef73f
18 Sep, 2025 1 commit
- [Feature] Speculative decoding support lookahead (#9873) · e7bc6003
  Zhihao Zhang authored Sep 19, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  e7bc6003
17 Sep, 2025 1 commit
- feat: add priority based scheduling with priority based request acceptance and preemption (#8746) · 14fdd527
  harrisonlimh authored Sep 16, 2025
  
  14fdd527
15 Sep, 2025 2 commits
- [PD metrics] Add latency Histogram metrics of each stage for generate requests (#8710) · b1721edb
  Yingchun Lai authored Sep 16, 2025
  
  b1721edb
- Refactor TopK to ensure readability and extensibility (#9338) · 4844fac9
  Cheng Wan authored Sep 14, 2025
  
  4844fac9