Commits · 132dad874d2e44592d03a112e4b7d63b153e8346 · zhaoyu6 / sglang

"...lm-evaluation-harness.git" did not exist on "6f9630c8ebd5277af45cef3201f8e15e84c9be76"

07 Jun, 2025 1 commit
- [PD] Optimize transfer queue forward logic for dummy rank (#6922) · 132dad87
  shangmingc authored Jun 07, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  132dad87
05 Jun, 2025 1 commit
- [PD] Fix potential perf spike caused by tracker gc and optimize doc (#6764) · dd1012fc
  shangmingc authored Jun 06, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  dd1012fc
04 Jun, 2025 1 commit
- feat: add dp-rank to KV events (#6852) · f0f84975
  ishandhanani authored Jun 04, 2025
  
  f0f84975
30 May, 2025 1 commit
- [PD] Optimize time out logic and add env var doc for mooncake (#6761) · 6cb00c63
  shangmingc authored May 30, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  6cb00c63
29 May, 2025 3 commits
- PD Rust LB (PO2) (#6437) · 78689d33
  Liangsheng Yin authored May 29, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  78689d33
- [PD] Support completion endpoint (#6729) · 1dc6864f
  shangmingc authored May 29, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  1dc6864f
- [PD] bug fix: Update status if nixl receiver send a a dummy req. (#6720) · c459536b
  dongmao zhang authored May 29, 2025
  
  c459536b
28 May, 2025 5 commits
- [PD] Remove Unnecessary Exception Handling for FastQueue.get() (#6712) · 5170b010
  Hongbo Xu authored May 29, 2025
  
  5170b010
- [Bugfix] Fix ChatCompletion endpoint of mini_lb when stream is set (#6703) · e9fd11c0
  shangmingc authored May 28, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  e9fd11c0
- [Bugfix] Fix slice operation when chunk size mismatch (#6697) · c7588d59
  shangmingc authored May 28, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  c7588d59
- [PD Perf] replace Queue to FastQueue (#6649) · 6b231325
  ybyang authored May 28, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Co-authored-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  6b231325
- [PD] Abort unbootstrapped prefill requests through timeout (#6685) · b1c8d4e9
  shangmingc authored May 28, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  b1c8d4e9
27 May, 2025 3 commits
- [PD] Make bootstrap code common between NIXL and Mooncake (#6473) · e806f708
  Trevor Morris authored May 27, 2025
  
  e806f708
- Super tiny rename environment variable (#6648) · 1a8f5f68
  fzyzcjy authored May 27, 2025
  
  1a8f5f68
- [PD] Handle P/D failure and reconnect without affecting other instances (#6263) · 3ce94f71
  shangmingc authored May 27, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  3ce94f71
26 May, 2025 1 commit
- [PD] Fix prefill_servers in mini_lb (#6527) · 8b33d8df
  wangxiyu191 authored May 26, 2025
  
  8b33d8df
24 May, 2025 1 commit
- [PD] Support structured output (#6560) · 2d831c6e
  Byron Hsu authored May 23, 2025
  
  2d831c6e
23 May, 2025 3 commits
- [PD] Support logprob & Add failure test (#6558) · 8233cc10
  Byron Hsu authored May 23, 2025
  
  8233cc10
- [PD] support spec decode (#6507) · d2e0881a
  Byron Hsu authored May 23, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  d2e0881a
- [PD] Fix failure abort (#6535) · 0a4fc73b
  Byron Hsu authored May 22, 2025
  
  0a4fc73b
22 May, 2025 3 commits
- Fix missing http status import for PD failure handler (#6520) · 58f10679
  shangmingc authored May 22, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  58f10679
- [PD] Abort request if transfer fails (#6504) · 3bde1010
  Byron Hsu authored May 21, 2025
  
  3bde1010
- [PD] Add doc and simplify sender.send (#6019) · 75135580
  Byron Hsu authored May 21, 2025
  
  75135580
21 May, 2025 1 commit
- Refactor group_concurrent_contiguous in NIXL (#6214) · 30ca18f4
  Yuan Luo authored May 21, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  30ca18f4
19 May, 2025 1 commit
- [Metrics] Add KV events publishing (#6098) · 7adf245b
  Trevor Morris authored May 19, 2025
  
  7adf245b
15 May, 2025 1 commit
- Minor improvements of TokenizerManager / health check (#6327) · e07a6977
  Lianmin Zheng authored May 15, 2025
  
  e07a6977
12 May, 2025 2 commits
- [PD] Add support for different TP sizes per DP rank (#5922) · f1c89600
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  f1c89600
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
11 May, 2025 1 commit
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
06 May, 2025 2 commits
- Better PD initialization (#5751) · a3e4e9bf
  Liangsheng Yin authored May 07, 2025
  
  a3e4e9bf
- Fix not "import os" (#6057) · 6d4d3bc8
  Liangsheng Yin authored May 06, 2025
  
  6d4d3bc8
05 May, 2025 1 commit
- [PD] Allow customizing reserved tokens to avoid KV cache waste (#6002) · 3008db9c
  fzyzcjy authored May 05, 2025
  
  3008db9c
02 May, 2025 1 commit
- [PD] NIXL backend Prefill TP & Decode TP+DP (#5681) · 97ac42b6
  Yongtong Wu authored May 02, 2025
  
  97ac42b6
01 May, 2025 1 commit
- [PD] Vectorise group_concurrent_contiguous in NumPy (#5834) · 67b7d5b1
  Yuan Luo authored May 01, 2025
```
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
```
  67b7d5b1
28 Apr, 2025 2 commits
- [PD] support pd fake transfer for warmup (#5726) · c6c62640
  ybyang authored Apr 29, 2025
  
  c6c62640
- Improve overlap scheduling (#5788) · 40d9b8ac
  Liangsheng Yin authored Apr 28, 2025
  
  40d9b8ac
27 Apr, 2025 1 commit
- [PD]Reduce kv transfer threads (#5791) · beb65c74
  Liangsheng Yin authored Apr 27, 2025
  
  beb65c74
25 Apr, 2025 3 commits
- [PD]: Support Muti Prefill in one node (#5704) · 11e27d09
  IAN authored Apr 26, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
```
  11e27d09
- [PD] Add kvargs table and thread pool for kvcache sender of mooncake (#5738) · 50eda839
  shangmingc authored Apr 25, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  50eda839
- [PD] Better logs (#5715) · c55550cb
  Liangsheng Yin authored Apr 25, 2025
  
  c55550cb