Commits · e2ac7888b8cb1fd6c33a7ec58d27a5f5b5b24e0c · change / sglang

22 Sep, 2025 1 commit
- [2/2] Support deterministic inference for temperature > 0 (#10678) · e2ac7888
  Qiaolin Yu authored Sep 21, 2025
```
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
```
  e2ac7888
18 Sep, 2025 1 commit
- [RL] Add destroy process group api (#9979) · 93f75778
  penguin_wwy authored Sep 19, 2025
  
  93f75778
17 Sep, 2025 1 commit
- feat: add priority based scheduling with priority based request acceptance and preemption (#8746) · 14fdd527
  harrisonlimh authored Sep 16, 2025
  
  14fdd527
13 Sep, 2025 1 commit
- [Generative Score API] Scoring(Prefill-only) optimizations. (#9748) · a360511d
  Sundara Raman Ramachandran authored Sep 13, 2025
  
  a360511d
12 Sep, 2025 1 commit

Support loading weights from remote instance (#8215) · 30d20ce8

amysaq2023 authored Sep 12, 2025


Signed-off-by: Anqi Shen <amy.saq@antgroup.com>
Co-authored-by: Chayenne <74843776+zhaochenyang20@users.noreply.github.com>

30d20ce8

10 Sep, 2025 1 commit
- Fix assertion typo in tp_worker.py (#9954) · 0ac809de
  Seunggeun Cho authored Sep 10, 2025
  
  0ac809de
09 Sep, 2025 1 commit
- [Refactor] Remove Hicache Load & Write threads (#10127) · 948b01a0
  DarkSharpness authored Sep 08, 2025
```
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
```
  948b01a0
05 Sep, 2025 1 commit
- [Fix] Add speculative_draft_model_revision to server_args (#5255) · 13705dae
  DevashishLal-CB authored Sep 05, 2025
```
Signed-off-by: Devashish Lal <devashish@rivosinc.com>
```
  13705dae
23 Aug, 2025 1 commit
- Overlapped weight offload (#8034) · 2600fc0d
  fzyzcjy authored Aug 23, 2025
  
  2600fc0d
07 Aug, 2025 1 commit
- Support GPU pinning for LoRA (#8697) · 6210e2c4
  Lifu Huang authored Aug 06, 2025
  
  6210e2c4
31 Jul, 2025 1 commit
- [Feature] Hybrid EP and TP (#8590) · 7a1f7fc5
  Cheng Wan authored Jul 31, 2025
  
  7a1f7fc5
28 Jul, 2025 1 commit
- feat: throttle requests at scheduler based on --max_queued_requests (#7565) · 747dd450
  harrisonlimh authored Jul 28, 2025
  
  747dd450
26 Jul, 2025 1 commit

Extract update_weights from RL Engine to SGLang to keep simplicity and fix torch reduce (#8267) · ce32bc2b

Stefan He authored Jul 26, 2025

Co-authored-by: CuiBo 82354186+SuperCB@users.noreply.github.com
Co-authored-by: GeLee 865038696@qq.com
Co-authored-by: 杨睿 yangruipis@163.com

ce32bc2b

23 Jul, 2025 1 commit
- Introduce Stable LoRA ID System for Overlapped Updates and Prefix Caching (#8261) · 8abd3e77
  Lifu Huang authored Jul 23, 2025
  
  8abd3e77
18 Jul, 2025 1 commit
- Revert "Fix different device type adjustment in PP" (#8141) · d0510f08
  Sai Enduri authored Jul 18, 2025
  
  d0510f08
16 Jul, 2025 1 commit
- Fix different device type adjustment in PP (#7760) · 3bc43c68
  Qiaolin Yu authored Jul 15, 2025
  
  3bc43c68
13 Jul, 2025 1 commit
- SWA Prefix Cache (#7367) · 9379da77
  Hanming Lu authored Jul 13, 2025
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  9379da77
03 Jul, 2025 1 commit
- [RL] support update_weights_from_distributed with different group and multiple weights (#7292) · 0626f678
  Zilin Zhu authored Jul 03, 2025
  
  0626f678
28 Jun, 2025 1 commit
- Support dynamic LoRA loading / unloading in engine/server API (#7446) · 49538d11
  Lifu Huang authored Jun 27, 2025
  
  49538d11
22 Jun, 2025 1 commit
- [minor] simplify the `TokenToKVPoolAllocator` (#7414) · 05c9bc89
  Liangsheng Yin authored Jun 22, 2025
  
  05c9bc89
18 Jun, 2025 1 commit
- Upstreaming hicache bug fixes (#7267) · e56685ac
  Zhiqiang Xie authored Jun 17, 2025
  
  e56685ac
12 May, 2025 1 commit
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
08 May, 2025 1 commit
- Tiny refactor ModelConfig.from_server_args (#5219) · b6cf3532
  fzyzcjy authored May 08, 2025
  
  b6cf3532
02 May, 2025 1 commit

Support InternVL3 (#5350) · 3409aaab

xm:D authored May 02, 2025


Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>

3409aaab

01 May, 2025 1 commit
- [PP] Add pipeline parallelism (#5724) · 11383cec
  Ying Sheng authored Apr 30, 2025
  
  11383cec
29 Apr, 2025 1 commit
- Auto set draft model path for MTP (#5793) · dd408ee4
  Ke Bao authored Apr 30, 2025
  
  dd408ee4
28 Apr, 2025 1 commit
- Improve overlap scheduling (#5788) · 40d9b8ac
  Liangsheng Yin authored Apr 28, 2025
  
  40d9b8ac
21 Apr, 2025 1 commit
- Add sanity check for max_running_requests (#5016) · 5fc4b600
  fzyzcjy authored Apr 21, 2025
  
  5fc4b600
11 Apr, 2025 1 commit
- Support `--enable-llama4-multimodal` (#5254) · 038bc5d5
  Cheng Wan authored Apr 11, 2025
  
  038bc5d5
28 Mar, 2025 2 commits
- Clean up `import vllm` in quantization/__init__.py (#4834) · 74e0ac1d
  Lianmin Zheng authored Mar 28, 2025
  
  74e0ac1d
- [Fix] `self.worker` assignment in `TpModelWorker` and refactor references (#4788) · 42a45df0
  XinyuanTong authored Mar 27, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  42a45df0
17 Mar, 2025 1 commit
- [Fix] Resolve GPU Memory Leak in update_weights_from_tensor (#4446) · 91ba98fe
  Wei Wu authored Mar 17, 2025
  
  91ba98fe
05 Mar, 2025 1 commit
- [Eagle] Refactor eagle speculative decoding (#3986) · d3d4d767
  Ying Sheng authored Mar 05, 2025
```
Co-authored-by: Ke Bao <ISPObaoke@163.com>
```
  d3d4d767
03 Mar, 2025 1 commit

Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727

Lianmin Zheng authored Mar 03, 2025


Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

ac238727

28 Feb, 2025 1 commit
- [Feature] SPMD for SGLang + Verl (#3852) · e3e0bc50
  fzyzcjy authored Mar 01, 2025
  
  e3e0bc50
19 Jan, 2025 1 commit
- fix missing revision arg when loading tokenizer (#2982) · 8b6a4486
  giorgiopiatti-dfinity authored Jan 19, 2025
  
  8b6a4486
16 Jan, 2025 1 commit
- Support multi-node DP attention (#2925) · 8b6ce52e
  Lianmin Zheng authored Jan 16, 2025
```
Co-authored-by: dhou-xai <dhou@x.ai>
```
  8b6ce52e
02 Jan, 2025 2 commits
- Eagle speculative decoding part 3: small modifications to the general scheduler (#2709) · ad20b795
  Lianmin Zheng authored Jan 02, 2025
```
Co-authored-by: kavioyu <kavioyu@tencent.com>
```
  ad20b795
- Speed up `update_weights_from_tensor` (#2695) · 9183c23e
  fzyzcjy authored Jan 02, 2025
  
  9183c23e
31 Dec, 2024 1 commit
- Eagle speculative decoding part 2: Fix cuda graph + DP attention hanging (#2684) · b0524c37
  Lianmin Zheng authored Dec 31, 2024
```
Co-authored-by: yukavio <kavioyu@gmail.com>
```
  b0524c37