Commits · 1b9cea5ade6fe34bfafcff24b177e1ae6f5cb14f · change / sglang · GitLab

25 Jul, 2025 1 commit
- [P/D] Support ipv6 in P/D scenario (#7858) · 1b9cea5a
  Stepan Kargaltsev authored Jul 25, 2025
```
Co-authored-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  1b9cea5a
19 Jul, 2025 1 commit
- [PD] Support non-MLA models PD different TP with DP attention (#7931) · 1403ea56
  Shangming Cai authored Jul 19, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  1403ea56
13 Jul, 2025 1 commit
- Tiny fix mooncake log warning wrong output (#7952) · c46e069d
  fzyzcjy authored Jul 13, 2025
  
  c46e069d
12 Jul, 2025 1 commit
- Revert "[PD Disaggregation] replace transfer with batch transfer for better... · 880221bd
  fzyzcjy authored Jul 12, 2025
```
Revert "[PD Disaggregation] replace transfer with batch transfer for better performance (#7236)" (#7968)
```
  880221bd
11 Jul, 2025 1 commit
- [feature] kv transfer support of ascend npu (#7795) · 86044712
  ronnie_zheng authored Jul 11, 2025
```
Co-authored-by: liupeng <liupeng374@huawei.com>
```
  86044712
09 Jul, 2025 1 commit
- [PD] Add guidance for prefill bootstrap timeout (#7846) · 64c5907e
  Shangming Cai authored Jul 09, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  64c5907e
26 Jun, 2025 1 commit
- [PD] Raise error for incompatible mooncake version and some minor fixes (#7527) · 5c214257
  Shangming Cai authored Jun 26, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  5c214257
25 Jun, 2025 3 commits
- feat: add return hidden_states at async generation (#7507) · 20beb370
  eigen authored Jun 25, 2025
  
  20beb370
- [PD] Add different TP sizes support for no-MLA models (#6793) · e21aa1df
  Hongbo Xu authored Jun 25, 2025
```
Co-authored-by: shangmingc <csmthu@gmail.com>
Co-authored-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  e21aa1df
- [PD][Spec] Fix hidden state transfer for spec decode (#7516) · 7b9a174a
  Shangming Cai authored Jun 25, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  7b9a174a
24 Jun, 2025 1 commit
- [PD Disaggregation] replace transfer with batch transfer for better performance (#7236) · 2ed68d7a
  Francis authored Jun 24, 2025
  
  2ed68d7a
19 Jun, 2025 1 commit
- [Bugfix][PD] Set conclude state before clear when failure happens (#7362) · f88e7085
  Shangming Cai authored Jun 20, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  f88e7085
18 Jun, 2025 1 commit
- [PD] Support get local ip from NIC for PD disaggregation (#7237) · ceaa85c9
  shangmingc authored Jun 18, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  ceaa85c9
15 Jun, 2025 1 commit
- [PD] use int32 for kv indices & get num_reserved_decode_tokens from server_args (#7214) · 88f9c347
  Byron Hsu authored Jun 15, 2025
  
  88f9c347
14 Jun, 2025 1 commit
- [PD] Update prefill.py (#7190) · 7d316991
  Byron Hsu authored Jun 14, 2025
  
  7d316991
09 Jun, 2025 1 commit
- feat: add direct routing strategy to DP worker (#6884) · f1569876
  ishandhanani authored Jun 09, 2025
  
  f1569876
07 Jun, 2025 1 commit
- [PD] Optimize transfer queue forward logic for dummy rank (#6922) · 132dad87
  shangmingc authored Jun 07, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  132dad87
05 Jun, 2025 1 commit
- [PD] Fix potential perf spike caused by tracker gc and optimize doc (#6764) · dd1012fc
  shangmingc authored Jun 06, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  dd1012fc
30 May, 2025 1 commit
- [PD] Optimize time out logic and add env var doc for mooncake (#6761) · 6cb00c63
  shangmingc authored May 30, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  6cb00c63
28 May, 2025 4 commits
- [PD] Remove Unnecessary Exception Handling for FastQueue.get() (#6712) · 5170b010
  Hongbo Xu authored May 29, 2025
  
  5170b010
- [Bugfix] Fix slice operation when chunk size mismatch (#6697) · c7588d59
  shangmingc authored May 28, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  c7588d59
- [PD Perf] replace Queue to FastQueue (#6649) · 6b231325
  ybyang authored May 28, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  6b231325
- [PD] Abort unbootstrapped prefill requests through timeout (#6685) · b1c8d4e9
  shangmingc authored May 28, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  b1c8d4e9
27 May, 2025 3 commits
- [PD] Make bootstrap code common between NIXL and Mooncake (#6473) · e806f708
  Trevor Morris authored May 27, 2025
  
  e806f708
- Super tiny rename environment variable (#6648) · 1a8f5f68
  fzyzcjy authored May 27, 2025
  
  1a8f5f68
- [PD] Handle P/D failure and reconnect without affecting other instances (#6263) · 3ce94f71
  shangmingc authored May 27, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  3ce94f71
23 May, 2025 1 commit
- [PD] support spec decode (#6507) · d2e0881a
  Byron Hsu authored May 23, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  d2e0881a
22 May, 2025 2 commits
- [PD] Abort request if transfer fails (#6504) · 3bde1010
  Byron Hsu authored May 21, 2025
  
  3bde1010
- [PD] Add doc and simplify sender.send (#6019) · 75135580
  Byron Hsu authored May 21, 2025
  
  75135580
12 May, 2025 1 commit
- [PD] Add support for different TP sizes per DP rank (#5922) · f1c89600
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  f1c89600
11 May, 2025 1 commit
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
01 May, 2025 1 commit
- [PD] Vectorise group_concurrent_contiguous in NumPy (#5834) · 67b7d5b1
  Yuan Luo authored May 01, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  67b7d5b1
27 Apr, 2025 1 commit
- [PD]Reduce kv transfer threads (#5791) · beb65c74
  Liangsheng Yin authored Apr 27, 2025
  
  beb65c74
25 Apr, 2025 1 commit
- [PD] Add kvargs table and thread pool for kvcache sender of mooncake (#5738) · 50eda839
  shangmingc authored Apr 25, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  50eda839
23 Apr, 2025 1 commit
- [PD] Add support for dp attention with mooncake (#5530) · e0673969
  shangmingc authored Apr 23, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  e0673969
21 Apr, 2025 1 commit
- [PD] Fix large page size + chunk prefill (#5588) · c951d312
  Byron Hsu authored Apr 20, 2025
  
  c951d312
19 Apr, 2025 2 commits
- [PD] Remove the requirement of config file for mooncake backend (#5460) · dca90f1d
  shangmingc authored Apr 19, 2025
  
  dca90f1d
- [PD] Fix no cache connect for recevier (#5534) · 59dd090f
  ybyang authored Apr 19, 2025
  
  59dd090f
15 Apr, 2025 2 commits
- [PD] Remove unused bootstrap param and fix port table type (#5423) · f1b3b75f
  shangmingc authored Apr 15, 2025
  
  f1b3b75f
- Distinguish bootstrap key only in decode server (#5422) · 33b16ad1
  Liangsheng Yin authored Apr 15, 2025
  
  33b16ad1