Commits · 138ff23187a8c75f68ecc7afddf33f2d3ee494d4 · change / sglang

23 Oct, 2025 1 commit
- Allow to disable batch decoding. (#11944) · 138ff231
  Jue WANG authored Oct 22, 2025
  
  138ff231
21 Oct, 2025 1 commit

Simplify multi-tokenizer (#11295) · 260fe755

Zhengke Zhou authored Oct 21, 2025


Signed-off-by: zhengkezhou1 <madzhou1@gmail.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>

260fe755

19 Oct, 2025 1 commit
- [overlap-spec] fix stop condition and trimming (#11819) · d658f049
  Liangsheng Yin authored Oct 19, 2025
  
  d658f049
13 Oct, 2025 1 commit
- Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11441) · b6fb5d76
  Scott Lee authored Oct 13, 2025
  
  b6fb5d76
12 Oct, 2025 1 commit
- Sync changes on io_struct.py and deterministic ops (#11498) · 2ac46e94
  Lianmin Zheng authored Oct 12, 2025
  
  2ac46e94
10 Oct, 2025 2 commits
- Revert "Add metrics for speculative decoding (acceptance rate, average acceptance length)" (#11433) · 55b14656
  Scott Lee authored Oct 10, 2025
  
  55b14656
- Add metrics for speculative decoding (acceptance rate, average acceptance length) (#11144) · 0babd487
  Scott Lee authored Oct 10, 2025
  
  0babd487
03 Oct, 2025 2 commits
- Tiny move files to utils folder (#11166) · fdc4e1e5
  fzyzcjy authored Oct 03, 2025
  
  fdc4e1e5
- Introduce naming convention in `io_struct` and base sglang io classes. (#10133) · 3c699772
  Liangsheng Yin authored Oct 03, 2025
  
  3c699772
15 Sep, 2025 1 commit
- [4/N]DP refactor: support watching mode `get_load` and shortest queue strategy (#10201) · 305c9e8c
  Liangsheng Yin authored Sep 15, 2025
  
  305c9e8c
09 Sep, 2025 1 commit

[Auto Sync] Update io_struct.py (20250909) (#10236) · bf72b801

Lianmin Zheng authored Sep 09, 2025


Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>

bf72b801

07 Sep, 2025 1 commit
- [1/2] Refactor multi-tokenizer manager (#10074) · e719bb0e
  Liangsheng Yin authored Sep 07, 2025
  
  e719bb0e
02 Sep, 2025 1 commit
- Move multi-tokenizer event loop to better place (#9902) · a25e8e42
  Shangming Cai authored Sep 02, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  a25e8e42
01 Sep, 2025 1 commit

Support Multi Process Tokenizer Manager(#6555) (#8964) · 5f77e129

ybyang authored Sep 01, 2025


Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>

5f77e129

25 Aug, 2025 1 commit

Fix Harmony reasoning parser for and auto-separation for gpt-oss models (#9190) · a0a77d93

Jonas authored Aug 26, 2025


Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: minleminzui <2969413251@qq.com>
Co-authored-by: maocheng23 <maocheng@berkeley.edu>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

a0a77d93

23 Aug, 2025 1 commit

Support GC Freezing to improve latency & throughput (#9241) · 127d4b0d

Chanh Nguyen authored Aug 22, 2025


Co-authored-by: Chanh Nguyen <cnguyen@linkedin.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>

127d4b0d

22 Aug, 2025 1 commit
- Revert "bugfix: Fix output_ids extraction in detokenizer_manager" (#9467) · 6c855db8
  Xinyuan Tong authored Aug 22, 2025
  
  6c855db8
11 Aug, 2025 1 commit
- bugfix: Fix output_ids extraction in detokenizer_manager (#9047) · a6452b71
  Chang Su authored Aug 11, 2025
  
  a6452b71
08 Aug, 2025 2 commits

Revert "Support Multi Process Tokenizer Manager" (#8960) · a9471542
Lianmin Zheng authored Aug 08, 2025

a9471542

Support Multi Process Tokenizer Manager (#6555) · 7490e3f6

ybyang authored Aug 08, 2025


Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: lw9527 <952799980@qq.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>

7490e3f6

06 Aug, 2025 1 commit

Support v1/responses and use harmony in serving_chat (#8837) · 92cc32d9

Chang Su authored Aug 06, 2025


Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

92cc32d9

12 May, 2025 1 commit
- Support incremental streaming of logprob/token_ids between scheduler and detokenizer (#6225) · d18c6b33
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  d18c6b33
16 Apr, 2025 1 commit
- Clean up imports (#5467) · 177320a5
  Lianmin Zheng authored Apr 16, 2025
  
  177320a5
05 Mar, 2025 1 commit
- [Minor] more code cleanup (#4077) · e074d84e
  Lianmin Zheng authored Mar 04, 2025
  
  e074d84e
03 Mar, 2025 2 commits

Misc clean up; Remove the support of jump forward (#4032) · 935cda94
Lianmin Zheng authored Mar 03, 2025

935cda94

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

22 Feb, 2025 1 commit
- Improve: Use TypeBasedDispatcher in DetokenizerManager (#3117) · 90876940
  fzyzcjy authored Feb 22, 2025
  
  90876940
21 Feb, 2025 1 commit
- [bug] fixed batch api for DeepSeek V3/R1 (#3754) · 9af0e21e
  Shenggui Li authored Feb 22, 2025
  
  9af0e21e
10 Feb, 2025 1 commit
- [Feat] Return hidden states (experimental) (#3364) · 5f0e7de3
  Jackmin801 authored Feb 10, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  5f0e7de3
26 Jan, 2025 1 commit
- Return more infos for computing average acceptance length (#3152) · 1dda8c5e
  Lianmin Zheng authored Jan 26, 2025
  
  1dda8c5e
19 Jan, 2025 2 commits
- [#2812] Make the decode status dict capcity adjustable by a CLI param (#2839) · d77caa2b
  Seungduk Kim authored Jan 20, 2025
  
  d77caa2b
- fix missing revision arg when loading tokenizer (#2982) · 8b6a4486
  giorgiopiatti-dfinity authored Jan 19, 2025
  
  8b6a4486
16 Jan, 2025 1 commit
- Fix zmq binding (#2930) · 0427416b
  Lianmin Zheng authored Jan 16, 2025
```
Co-authored-by: Chunyuan WU <chunyuan.wu@intel.com>
```
  0427416b
15 Jan, 2025 1 commit
- Remove normalized_prompt_logprobs from the engine to make code easier to maintain (#2902) · f65c13b5
  Lianmin Zheng authored Jan 15, 2025
  
  f65c13b5
11 Jan, 2025 1 commit
- Improve: Token-In Token-Out Usage for RLHF (#2843) · c4f9707e
  Shi Shuai authored Jan 11, 2025
  
  c4f9707e
29 Dec, 2024 1 commit
- [Feature] Get Token IDs with Engine.generate() (#2636) · 35bdb485
  Shi Shuai authored Dec 29, 2024
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  35bdb485
09 Dec, 2024 1 commit
- [Minor] Improve code style (#2419) · 0ce091a8
  Lianmin Zheng authored Dec 09, 2024
  
  0ce091a8
08 Dec, 2024 2 commits
- Simplify stream_output (#2398) · a6ca736c
  Lianmin Zheng authored Dec 08, 2024
  
  a6ca736c
- nit: Remove busy waiting on scheduler (#2382) · 1f09e84b
  SangBin Cho authored Dec 08, 2024
  
  1f09e84b
28 Nov, 2024 1 commit
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70