Commits · 2d62af6be517215c6c593d6bbef21d8c690a955b · change / sglang

01 Oct, 2025 1 commit
- Fix metrics and request tracing (TimeStats) (#11123) · 2d62af6b
  Lianmin Zheng authored Oct 01, 2025
  
  2d62af6b
27 Sep, 2025 1 commit
- Add support for topk metadata transferring for PD (#10616) · e23e280e
  Shangming Cai authored Sep 28, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  e23e280e
26 Sep, 2025 1 commit
- [PD-HiCache]: Support Async Offloading KVCache In Decode Side (#10192) · 7ec5b4e8
  hzh0425 authored Sep 26, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
```
  7ec5b4e8
05 Sep, 2025 2 commits
- [Vulnerability]feat(conn): set bootstrap server host (#9931) · f40038fb
  Jimmy authored Sep 05, 2025
  
  f40038fb
- Simplify `Router` arguments passing and build it in docker image (#9964) · 6e95f5e5
  Liangsheng Yin authored Sep 05, 2025
  
  6e95f5e5
21 Aug, 2025 1 commit
- [PD] Fix nvlink transport accuracy through transferring metadata with tcp (#9261) · 25ef53f0
  Shangming Cai authored Aug 21, 2025
```
Signed-off-by: Shangming Cai <csmthu@gmail.com>
```
  25ef53f0
11 Jul, 2025 1 commit
- [feature] kv transfer support of ascend npu (#7795) · 86044712
  ronnie_zheng authored Jul 11, 2025
```
Co-authored-by: liupeng <liupeng374@huawei.com>
```
  86044712
05 Jul, 2025 1 commit
- [Fix] Alloc return type error (#7778) · af564774
  Caproni authored Jul 05, 2025
```
Signed-off-by: Capronir <839972205@qq.com>
```
  af564774
25 Jun, 2025 1 commit
- [PD][Spec] Fix hidden state transfer for spec decode (#7516) · 7b9a174a
  Shangming Cai authored Jun 25, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  7b9a174a
19 Jun, 2025 1 commit
- [PD] Transfer hidden states for mtp when disaggregation (#7242) · 4f838c09
  Atream authored Jun 20, 2025
  
  4f838c09
18 Jun, 2025 1 commit
- [PD] Add custom memory pool option to support Mooncake PD with NVLink (#7264) · c26d7349
  shangmingc authored Jun 18, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  c26d7349
15 Jun, 2025 1 commit
- Minor PD style fix (#7215) · 96be97bf
  Byron Hsu authored Jun 15, 2025
  
  96be97bf
14 Jun, 2025 1 commit
- [PD] Update prefill.py (#7190) · 7d316991
  Byron Hsu authored Jun 14, 2025
  
  7d316991
28 May, 2025 1 commit

[PD Perf] replace Queue to FastQueue (#6649) · 6b231325

ybyang authored May 28, 2025


Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: Shangming Cai <caishangming@linux.alibaba.com>

6b231325

27 May, 2025 1 commit
- [PD] Make bootstrap code common between NIXL and Mooncake (#6473) · e806f708
  Trevor Morris authored May 27, 2025
  
  e806f708
23 May, 2025 2 commits
- [PD] Support logprob & Add failure test (#6558) · 8233cc10
  Byron Hsu authored May 23, 2025
  
  8233cc10
- [PD] Fix failure abort (#6535) · 0a4fc73b
  Byron Hsu authored May 22, 2025
  
  0a4fc73b
22 May, 2025 1 commit
- [PD] Abort request if transfer fails (#6504) · 3bde1010
  Byron Hsu authored May 21, 2025
  
  3bde1010
15 May, 2025 1 commit
- Minor improvements of TokenizerManager / health check (#6327) · e07a6977
  Lianmin Zheng authored May 15, 2025
  
  e07a6977
12 May, 2025 1 commit
- [PD] Add support for different TP sizes per DP rank (#5922) · f1c89600
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  f1c89600
11 May, 2025 1 commit
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
06 May, 2025 1 commit
- Better PD initialization (#5751) · a3e4e9bf
  Liangsheng Yin authored May 07, 2025
  
  a3e4e9bf
28 Apr, 2025 1 commit
- [PD] support pd fake transfer for warmup (#5726) · c6c62640
  ybyang authored Apr 29, 2025
  
  c6c62640
21 Apr, 2025 3 commits
- [PD] Add NIXL transfer backend (#5477) · 4dce1cc6
  Trevor Morris authored Apr 21, 2025
  
  4dce1cc6
- [PD] Fix edge case and simplify large page size + chunked prefill (#5589) · deded17f
  Byron Hsu authored Apr 21, 2025
  
  deded17f
- [PD] Fix large page size + chunk prefill (#5588) · c951d312
  Byron Hsu authored Apr 20, 2025
  
  c951d312
20 Apr, 2025 1 commit
- [PD] Support page size > 1 (#5561) · ab4b5606
  Byron Hsu authored Apr 19, 2025
  
  ab4b5606
13 Apr, 2025 1 commit
- [PD] Add transfer backend abstraction (#5328) · a9499885
  Byron Hsu authored Apr 13, 2025
  
  a9499885
21 Mar, 2025 1 commit

[PD] Release initial code (#4654) · c7c7dbeb

Byron Hsu authored Mar 21, 2025


Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Ying1123 <sqy1415@gmail.com>
Co-authored-by: merrymercy <lianminzheng@gmail.com>
Co-authored-by: makro
Co-authored-by: dhou-xai

c7c7dbeb