Commits · e719bb0e84b7ce507323c523ec2c41386b43623e · zhaoyu6 / sglang

07 Sep, 2025 1 commit
- [1/2] Refactor multi-tokenizer manager (#10074) · e719bb0e
  Liangsheng Yin authored Sep 07, 2025
  
  e719bb0e
02 Sep, 2025 1 commit
- Move multi-tokenizer event loop to better place (#9902) · a25e8e42
  Shangming Cai authored Sep 02, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  a25e8e42
01 Sep, 2025 1 commit

Support Multi Process Tokenizer Manager(#6555) (#8964) · 5f77e129

ybyang authored Sep 01, 2025


Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>

5f77e129

25 Aug, 2025 1 commit

Fix Harmony reasoning parser for and auto-separation for gpt-oss models (#9190) · a0a77d93

Jonas authored Aug 26, 2025


Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: minleminzui <2969413251@qq.com>
Co-authored-by: maocheng23 <maocheng@berkeley.edu>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

a0a77d93

23 Aug, 2025 1 commit

Support GC Freezing to improve latency & throughput (#9241) · 127d4b0d

Chanh Nguyen authored Aug 22, 2025


Co-authored-by: Chanh Nguyen <cnguyen@linkedin.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>

127d4b0d

22 Aug, 2025 1 commit
- Revert "bugfix: Fix output_ids extraction in detokenizer_manager" (#9467) · 6c855db8
  Xinyuan Tong authored Aug 22, 2025
  
  6c855db8
11 Aug, 2025 1 commit
- bugfix: Fix output_ids extraction in detokenizer_manager (#9047) · a6452b71
  Chang Su authored Aug 11, 2025
  
  a6452b71
08 Aug, 2025 2 commits

Revert "Support Multi Process Tokenizer Manager" (#8960) · a9471542
Lianmin Zheng authored Aug 08, 2025

a9471542

Support Multi Process Tokenizer Manager (#6555) · 7490e3f6

ybyang authored Aug 08, 2025


Signed-off-by: ybyang <ybyang7@iflytek.com>
Signed-off-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: lw9527 <952799980@qq.com>
Co-authored-by: huanglong <huanglong@linux.alibaba.com>
Co-authored-by: Huang Long <121648372+LLLL114@users.noreply.github.com>

7490e3f6

06 Aug, 2025 1 commit

Support v1/responses and use harmony in serving_chat (#8837) · 92cc32d9

Chang Su authored Aug 06, 2025


Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>

92cc32d9

12 May, 2025 1 commit
- Support incremental streaming of logprob/token_ids between scheduler and detokenizer (#6225) · d18c6b33
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  d18c6b33
16 Apr, 2025 1 commit
- Clean up imports (#5467) · 177320a5
  Lianmin Zheng authored Apr 16, 2025
  
  177320a5
05 Mar, 2025 1 commit
- [Minor] more code cleanup (#4077) · e074d84e
  Lianmin Zheng authored Mar 04, 2025
  
  e074d84e
03 Mar, 2025 2 commits

Misc clean up; Remove the support of jump forward (#4032) · 935cda94
Lianmin Zheng authored Mar 03, 2025

935cda94

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

22 Feb, 2025 1 commit
- Improve: Use TypeBasedDispatcher in DetokenizerManager (#3117) · 90876940
  fzyzcjy authored Feb 22, 2025
  
  90876940
21 Feb, 2025 1 commit
- [bug] fixed batch api for DeepSeek V3/R1 (#3754) · 9af0e21e
  Shenggui Li authored Feb 22, 2025
  
  9af0e21e
10 Feb, 2025 1 commit
- [Feat] Return hidden states (experimental) (#3364) · 5f0e7de3
  Jackmin801 authored Feb 10, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  5f0e7de3
26 Jan, 2025 1 commit
- Return more infos for computing average acceptance length (#3152) · 1dda8c5e
  Lianmin Zheng authored Jan 26, 2025
  
  1dda8c5e
19 Jan, 2025 2 commits
- [#2812] Make the decode status dict capcity adjustable by a CLI param (#2839) · d77caa2b
  Seungduk Kim authored Jan 20, 2025
  
  d77caa2b
- fix missing revision arg when loading tokenizer (#2982) · 8b6a4486
  giorgiopiatti-dfinity authored Jan 19, 2025
  
  8b6a4486
16 Jan, 2025 1 commit
- Fix zmq binding (#2930) · 0427416b
  Lianmin Zheng authored Jan 16, 2025
```
Co-authored-by: Chunyuan WU <chunyuan.wu@intel.com>
```
  0427416b
15 Jan, 2025 1 commit
- Remove normalized_prompt_logprobs from the engine to make code easier to maintain (#2902) · f65c13b5
  Lianmin Zheng authored Jan 15, 2025
  
  f65c13b5
11 Jan, 2025 1 commit
- Improve: Token-In Token-Out Usage for RLHF (#2843) · c4f9707e
  Shi Shuai authored Jan 11, 2025
  
  c4f9707e
29 Dec, 2024 1 commit
- [Feature] Get Token IDs with Engine.generate() (#2636) · 35bdb485
  Shi Shuai authored Dec 29, 2024
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  35bdb485
09 Dec, 2024 1 commit
- [Minor] Improve code style (#2419) · 0ce091a8
  Lianmin Zheng authored Dec 09, 2024
  
  0ce091a8
08 Dec, 2024 2 commits
- Simplify stream_output (#2398) · a6ca736c
  Lianmin Zheng authored Dec 08, 2024
  
  a6ca736c
- nit: Remove busy waiting on scheduler (#2382) · 1f09e84b
  SangBin Cho authored Dec 08, 2024
  
  1f09e84b
28 Nov, 2024 1 commit
- Crash the server correctly during error (#2231) · d4fc1a70
  Lianmin Zheng authored Nov 28, 2024
  
  d4fc1a70
27 Nov, 2024 1 commit
- Fix flasky tests (#2212) · c754652f
  Lianmin Zheng authored Nov 26, 2024
  
  c754652f
25 Nov, 2024 1 commit
- [feat] Refactor session control interface and add CI (#2173) · e1e595d7
  Ying Sheng authored Nov 25, 2024
  
  e1e595d7
22 Nov, 2024 1 commit
- docs: fix module docstrings and copyright headers (#2077) · 62a4a339
  Xuehai Pan authored Nov 22, 2024
  
  62a4a339
20 Nov, 2024 1 commit
- [feat] Add session control (#2073) · 5942dfc0
  Ying Sheng authored Nov 20, 2024
  
  5942dfc0
15 Nov, 2024 1 commit
- Fix the default arguments of bench_offline_throughput.py & simplify detokenizer manager (#2042) · 2558d6a6
  Lianmin Zheng authored Nov 15, 2024
  
  2558d6a6
26 Oct, 2024 2 commits
- Fix possible ZMQ hanging (#1800) · 1e890341
  Liangsheng Yin authored Oct 25, 2024
  
  1e890341
- [Fix] Fix --skip-tokenizer-init (#1798) · fb99aaa5
  Lianmin Zheng authored Oct 25, 2024
  
  fb99aaa5
23 Oct, 2024 1 commit
- [API] add get memory pool size (#1760) · 2fce449b
  Ying Sheng authored Oct 23, 2024
```
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
```
  2fce449b
14 Oct, 2024 1 commit
- [Minor] Rename no_eos_trim to no_stop_trim (#1661) · 2725f8da
  Ying Sheng authored Oct 13, 2024
  
  2725f8da
13 Oct, 2024 1 commit
- [Fix] fix eos trim inconsistency (#1650) · 48761171
  Ying Sheng authored Oct 13, 2024
  
  48761171
04 Oct, 2024 1 commit
- Use ipc instead of tcp in zmq (#1566) · 114bbc86
  Lianmin Zheng authored Oct 04, 2024
  
  114bbc86