Commits · 7513558074adc4c4015b68e2ae7cf719d3401d5d · change / sglang

22 May, 2025 1 commit
- [PD] Add doc and simplify sender.send (#6019) · 75135580
  Byron Hsu authored May 21, 2025
  
  75135580
12 May, 2025 2 commits
- [PD] Add support for different TP sizes per DP rank (#5922) · f1c89600
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  f1c89600
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
28 Apr, 2025 2 commits
- [PD] support pd fake transfer for warmup (#5726) · c6c62640
  ybyang authored Apr 29, 2025
  
  c6c62640
- Improve overlap scheduling (#5788) · 40d9b8ac
  Liangsheng Yin authored Apr 28, 2025
  
  40d9b8ac
25 Apr, 2025 1 commit
- [PD] Better logs (#5715) · c55550cb
  Liangsheng Yin authored Apr 25, 2025
  
  c55550cb
23 Apr, 2025 1 commit
- Integrating PD disaggregation with DP attention and DeepEP (#5435) · 711efe78
  Cheng Wan authored Apr 23, 2025
```
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
```
  711efe78
21 Apr, 2025 3 commits
- [PD] Support prefill overlap + Ensure no race condition (#5609) · bf98d2e3
  Byron Hsu authored Apr 21, 2025
  
  bf98d2e3
- [PD] Fix edge case and simplify large page size + chunked prefill (#5589) · deded17f
  Byron Hsu authored Apr 21, 2025
  
  deded17f
- [PD] Fix large page size + chunk prefill (#5588) · c951d312
  Byron Hsu authored Apr 20, 2025
  
  c951d312
20 Apr, 2025 1 commit
- [PD] Support page size > 1 (#5561) · ab4b5606
  Byron Hsu authored Apr 19, 2025
  
  ab4b5606
19 Apr, 2025 1 commit
- [PD] Remove the requirement of config file for mooncake backend (#5460) · dca90f1d
  shangmingc authored Apr 19, 2025
  
  dca90f1d
16 Apr, 2025 1 commit
- Fix several minor issues in PD disaggregation (#5444) · 6aca5834
  Cheng Wan authored Apr 15, 2025
  
  6aca5834
15 Apr, 2025 2 commits
- Distinguish bootstrap key only in decode server (#5422) · 33b16ad1
  Liangsheng Yin authored Apr 15, 2025
  
  33b16ad1
- [PD] Fix dynamic port support and MLA buffer for Mooncake (#5415) · ffde65a0
  shangmingc authored Apr 15, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: ybyang <ybyang7@iflytek.com>
```
  ffde65a0
14 Apr, 2025 2 commits
- Fix PD disaggregation bugs (#5326) · 44afde82
  Liangsheng Yin authored Apr 14, 2025
  
  44afde82
- Free metadata_buffer_index after transfer finished (#5364) · 14e8bd88
  Yongtong Wu authored Apr 14, 2025
  
  14e8bd88
13 Apr, 2025 2 commits
- [PD] Add transfer backend abstraction (#5328) · a9499885
  Byron Hsu authored Apr 13, 2025
  
  a9499885
- Fix typo: infight -> inflight (#5357) · f7655790
  Liangsheng Yin authored Apr 14, 2025
  
  f7655790
10 Apr, 2025 1 commit

[PD] Support KV transfer with mooncake (#4880) · 4c31ae9f

Teng Ma authored Apr 10, 2025


Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Co-authored-by: shangmingc <csmthu@gmail.com>

4c31ae9f

21 Mar, 2025 1 commit

[PD] Release initial code (#4654) · c7c7dbeb

Byron Hsu authored Mar 21, 2025


Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Ying1123 <sqy1415@gmail.com>
Co-authored-by: merrymercy <lianminzheng@gmail.com>
Co-authored-by: makro
Co-authored-by: dhou-xai

c7c7dbeb