Commits · 132dad874d2e44592d03a112e4b7d63b153e8346 · zhaoyu6 / sglang

07 Jun, 2025 1 commit
- [PD] Optimize transfer queue forward logic for dummy rank (#6922) · 132dad87
  shangmingc authored Jun 07, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  132dad87
05 Jun, 2025 1 commit
- [PD] Fix potential perf spike caused by tracker gc and optimize doc (#6764) · dd1012fc
  shangmingc authored Jun 06, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  dd1012fc
30 May, 2025 1 commit
- [PD] Optimize time out logic and add env var doc for mooncake (#6761) · 6cb00c63
  shangmingc authored May 30, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  6cb00c63
28 May, 2025 4 commits
- [PD] Remove Unnecessary Exception Handling for FastQueue.get() (#6712) · 5170b010
  Hongbo Xu authored May 29, 2025
  
  5170b010
- [Bugfix] Fix slice operation when chunk size mismatch (#6697) · c7588d59
  shangmingc authored May 28, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  c7588d59
- [PD Perf] replace Queue to FastQueue (#6649) · 6b231325
  ybyang authored May 28, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  6b231325
- [PD] Abort unbootstrapped prefill requests through timeout (#6685) · b1c8d4e9
  shangmingc authored May 28, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  b1c8d4e9
27 May, 2025 3 commits
- [PD] Make bootstrap code common between NIXL and Mooncake (#6473) · e806f708
  Trevor Morris authored May 27, 2025
  
  e806f708
- Super tiny rename environment variable (#6648) · 1a8f5f68
  fzyzcjy authored May 27, 2025
  
  1a8f5f68
- [PD] Handle P/D failure and reconnect without affecting other instances (#6263) · 3ce94f71
  shangmingc authored May 27, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  3ce94f71
23 May, 2025 1 commit
- [PD] support spec decode (#6507) · d2e0881a
  Byron Hsu authored May 23, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  d2e0881a
22 May, 2025 2 commits
- [PD] Abort request if transfer fails (#6504) · 3bde1010
  Byron Hsu authored May 21, 2025
  
  3bde1010
- [PD] Add doc and simplify sender.send (#6019) · 75135580
  Byron Hsu authored May 21, 2025
  
  75135580
12 May, 2025 1 commit
- [PD] Add support for different TP sizes per DP rank (#5922) · f1c89600
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  f1c89600
11 May, 2025 1 commit
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
01 May, 2025 1 commit
- [PD] Vectorise group_concurrent_contiguous in NumPy (#5834) · 67b7d5b1
  Yuan Luo authored May 01, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  67b7d5b1
27 Apr, 2025 1 commit
- [PD]Reduce kv transfer threads (#5791) · beb65c74
  Liangsheng Yin authored Apr 27, 2025
  
  beb65c74
25 Apr, 2025 1 commit
- [PD] Add kvargs table and thread pool for kvcache sender of mooncake (#5738) · 50eda839
  shangmingc authored Apr 25, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  50eda839
23 Apr, 2025 1 commit
- [PD] Add support for dp attention with mooncake (#5530) · e0673969
  shangmingc authored Apr 23, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  e0673969
21 Apr, 2025 1 commit
- [PD] Fix large page size + chunk prefill (#5588) · c951d312
  Byron Hsu authored Apr 20, 2025
  
  c951d312
19 Apr, 2025 2 commits
- [PD] Remove the requirement of config file for mooncake backend (#5460) · dca90f1d
  shangmingc authored Apr 19, 2025
  
  dca90f1d
- [PD] Fix no cache connect for recevier (#5534) · 59dd090f
  ybyang authored Apr 19, 2025
  
  59dd090f
15 Apr, 2025 5 commits
- [PD] Remove unused bootstrap param and fix port table type (#5423) · f1b3b75f
  shangmingc authored Apr 15, 2025
  
  f1b3b75f
- Distinguish bootstrap key only in decode server (#5422) · 33b16ad1
  Liangsheng Yin authored Apr 15, 2025
  
  33b16ad1
- [PD] Fix dynamic port support and MLA buffer for Mooncake (#5415) · ffde65a0
  shangmingc authored Apr 15, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: ybyang <ybyang7@iflytek.com>
```
  ffde65a0
- Fix broadcast use cuda device lead to memory capacity unbalanced (#5416) · 471650de
  lambert0312 authored Apr 15, 2025
  
  471650de
- Support dynamic connection and TP 16 (#5351) · d06a83fb
  Yuan Luo authored Apr 15, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  d06a83fb
14 Apr, 2025 1 commit
- Fix PD disaggregation bugs (#5326) · 44afde82
  Liangsheng Yin authored Apr 14, 2025
  
  44afde82
13 Apr, 2025 1 commit
- [PD] Add transfer backend abstraction (#5328) · a9499885
  Byron Hsu authored Apr 13, 2025
  
  a9499885
10 Apr, 2025 1 commit

[PD] Support KV transfer with mooncake (#4880) · 4c31ae9f

Teng Ma authored Apr 10, 2025


Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Co-authored-by: shangmingc <csmthu@gmail.com>

4c31ae9f

21 Mar, 2025 1 commit

[PD] Release initial code (#4654) · c7c7dbeb

Byron Hsu authored Mar 21, 2025


Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Ying1123 <sqy1415@gmail.com>
Co-authored-by: merrymercy <lianminzheng@gmail.com>
Co-authored-by: makro
Co-authored-by: dhou-xai

c7c7dbeb