Commits · ea39952797ba489c37eec17883b89a43fd38c000 · zhaoyu6 / sglang

28 Oct, 2025 3 commits
- Revert "[Feature] PD-Multiplexing Context and Scheduler." (#12267) · ea399527
  Yineng Zhang authored Oct 28, 2025
  
  ea399527
- [Feature] Sglang Tracing: Fine-Grained Tracking for Request Latency - Part 2 (#10804) · ea961060
  Feng Su authored Oct 28, 2025
```
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
```
  ea961060
- Add per-request retraction count (#11177) · bf8f7a94
  Scott Lee authored Oct 27, 2025
  
  bf8f7a94
27 Oct, 2025 2 commits
- Add support for Matryoshka embeddings (#126) (#11142) · 9fc3e8aa
  satyamk7054 authored Oct 27, 2025
```
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
```
  9fc3e8aa
- [Feature] PD-Multiplexing Context and Scheduler. (#11592) · 05ad28f2
  ykcombat authored Oct 28, 2025
  
  05ad28f2
23 Oct, 2025 2 commits
- Fix mamba radix cache eviction logic in `alloc_req_slots` (#11616) · dbd9435d
  Roger Young authored Oct 24, 2025
```
Signed-off-by: rogeryoungh <rogeryoungh@foxmail.com>
```
  dbd9435d
- [Fix] memory leak by overlap + retract (#11981) · b0b4f716
  cctry authored Oct 23, 2025
```
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
```
  b0b4f716
21 Oct, 2025 2 commits
- Simplify multi-tokenizer (#11295) · 260fe755
  Zhengke Zhou authored Oct 21, 2025
```
Signed-off-by: zhengkezhou1 <madzhou1@gmail.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
```
  260fe755
- [code move] move pp into a separate mixin (#11838) · 01f14a7a
  Lianmin Zheng authored Oct 20, 2025
  
  01f14a7a
19 Oct, 2025 1 commit
- [overlap-spec] fix stop condition and trimming (#11819) · d658f049
  Liangsheng Yin authored Oct 19, 2025
  
  d658f049
17 Oct, 2025 2 commits
- [Lint] Add `python/sglang` to ruff F401 checks and remove unused imports in files (#11685) · 62797440
  Chang Su authored Oct 17, 2025
  
  62797440
- Abstraction for spec worker and code cleanup (#11643) · cde5a6e3
  Liangsheng Yin authored Oct 17, 2025
  
  cde5a6e3
15 Oct, 2025 1 commit
- Refactor kv cache free (#11351) · 1d7f7835
  cctry authored Oct 14, 2025
  
  1d7f7835
13 Oct, 2025 5 commits
- Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441) · b6fb5d76
  Scott Lee authored Oct 13, 2025
  
  b6fb5d76
- Adjust overlap event loop (#11507) · bfadb5ea
  Liangsheng Yin authored Oct 14, 2025
  
  bfadb5ea
- Depreate `global_server_args_dict` (#11528) · 516738b0
  Liangsheng Yin authored Oct 13, 2025
  
  516738b0
- [Feature] Support mamba radix cache v0 (#11214) · a55cf530
  Yi Zhang authored Oct 13, 2025
```
Co-authored-by: hanming-lu <hanming@x.ai>
Co-authored-by: hzh0425 <hzh0425@apache.org>
Co-authored-by: thalahors <ericalcaide1@gmail.com>
```
  a55cf530
- Revert "Deprecate `global_server_args_dict`" (#11520) · 1bdd0102
  Cheng Wan authored Oct 12, 2025
  
  1bdd0102
12 Oct, 2025 4 commits
- Deprecate `global_server_args_dict` (#11331) · 1083e7e3
  Liangsheng Yin authored Oct 13, 2025
  
  1083e7e3
- Move args from `global_config` to `environ` (#11332) · f4941906
  Liangsheng Yin authored Oct 12, 2025
  
  f4941906
- Beta spec-overlap for EAGLE (#11398) · 20a6c0a6
  Liangsheng Yin authored Oct 12, 2025
```
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  20a6c0a6
- [Feature] support regex strings as a stopping condition (#10635) · 47c606d3
  Glen Liu authored Oct 11, 2025
  
  47c606d3
11 Oct, 2025 2 commits
- fix stop when stream (#11462) · 5061b8fd
  ybyang authored Oct 11, 2025
```
Signed-off-by: ybyang <ybyang7@iflytek.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
```
  5061b8fd
- Separate allocation logic from scheduler (#11313) · b36afed4
  cctry authored Oct 10, 2025
  
  b36afed4
10 Oct, 2025 4 commits
- Revert "Add metrics for speculative decoding (acceptance rate, average acceptance length)" (#11433) · 55b14656
  Scott Lee authored Oct 10, 2025
  
  55b14656
- Revert "perf: optimize qwen-vl with symm mem allreduce" (#11436) · 52fcbbb8
  Cheng Wan authored Oct 10, 2025
  
  52fcbbb8
- perf: optimize qwen-vl with symm mem allreduce (#11381) · 3b9d97f3
  Yuan Luo authored Oct 10, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  3b9d97f3
- Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11144) · 0babd487
  Scott Lee authored Oct 10, 2025
  
  0babd487
09 Oct, 2025 1 commit
- [Generative Score API] Multi-Item scoring with custom attention mask. (#10979) · 53bd00d9
  Sundara Raman Ramachandran authored Oct 08, 2025
  
  53bd00d9
08 Oct, 2025 1 commit
- Clean match_prefix and prepare_for_extend for mem cache V2 (#11200) · f3764c26
  cctry authored Oct 07, 2025
  
  f3764c26
07 Oct, 2025 2 commits
- Remove sampling info events and overlap thread file (#11300) · 501dfa6b
  Liangsheng Yin authored Oct 07, 2025
  
  501dfa6b
- Remove overlap thread (#11210) · 1519a89c
  Liangsheng Yin authored Oct 07, 2025
```
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
```
  1519a89c
06 Oct, 2025 2 commits

Rename max_micro_batch_size -> pp_max_micro_batch_size (#11279) · 708f4ff4
Lianmin Zheng authored Oct 06, 2025

708f4ff4

Support DeepSeek V3.2 Exp (#11061) · efbc687c

fzyzcjy authored Oct 06, 2025


Co-authored-by: Stefan He <11166516+hebiao064@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <95566987+hnyls2002@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <56809903+fridge003@users.noreply.github.com>
Co-authored-by: DarkSharpness <76582120+darksharpness@users.noreply.github.com>
Co-authored-by: ZhengdQin <46387172+zhengdqin@users.noreply.github.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Zhengda Qin <zhengdqin@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

efbc687c

05 Oct, 2025 1 commit
- Tiny `skip_sample` adjust (#11225) · 4cb5a523
  Liangsheng Yin authored Oct 05, 2025
  
  4cb5a523
02 Oct, 2025 3 commits
- Unify forward output datastructure (#11124) · 458611de
  Liangsheng Yin authored Oct 03, 2025
  
  458611de
- Fix ngram spec with page size > 1 (#11135) · 25e7dbe8
  Liangsheng Yin authored Oct 02, 2025
  
  25e7dbe8
- Intoduce cpu tensor as metadata to avoid blocking gpu kernel launch (#10720) · 0b2aa8a7
  Zhang Junda authored Oct 02, 2025
```
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
```
  0b2aa8a7
01 Oct, 2025 2 commits
- Fix metrics and request tracing (TimeStats) (#11123) · 2d62af6b
  Lianmin Zheng authored Oct 01, 2025
  
  2d62af6b
- Organize spec-related data structures (#10735) · 73d4a5f8
  Liangsheng Yin authored Oct 01, 2025
  
  73d4a5f8