Commits · e5b29bf14e4008f6a9bb08dc6e7fcac1a22351fe · change / sglang

29 Aug, 2025 1 commit

[PD] Support get_model_info interface for mini_lb (#9792) · e5b29bf1

Xuchun Shang authored Aug 29, 2025


Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>

e5b29bf1

20 Aug, 2025 1 commit
- Fix mini lb timeout issue (#9369) · fe43e889
  fzyzcjy authored Aug 20, 2025
  
  fe43e889
25 Jul, 2025 1 commit
- [P/D] Support ipv6 in P/D scenario (#7858) · 1b9cea5a
  Stepan Kargaltsev authored Jul 25, 2025
```
Co-authored-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  1b9cea5a
18 Jun, 2025 2 commits
- Merge PDLB (Prefill-Decode Load Balancer) into SGLang Router (#7096) · 09ae5b20
  Simo Lin authored Jun 18, 2025
  
  09ae5b20
- Fix mini_lb for PD with long output: limit chunk size of decode response (#7301) · 2ae809c5
  ch-tiger1 authored Jun 19, 2025
```
Signed-off-by: ch-tiger1 <xyz@ch-tech.ip-ddns.com>
Co-authored-by: ch-tiger1 <xyz@ch-tech.ip-ddns.com>
```
  2ae809c5
29 May, 2025 2 commits
- PD Rust LB (PO2) (#6437) · 78689d33
  Liangsheng Yin authored May 29, 2025
```
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
```
  78689d33
- [PD] Support completion endpoint (#6729) · 1dc6864f
  shangmingc authored May 29, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  1dc6864f
28 May, 2025 1 commit
- [Bugfix] Fix ChatCompletion endpoint of mini_lb when stream is set (#6703) · e9fd11c0
  shangmingc authored May 28, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  e9fd11c0
26 May, 2025 1 commit
- [PD] Fix prefill_servers in mini_lb (#6527) · 8b33d8df
  wangxiyu191 authored May 26, 2025
  
  8b33d8df
23 May, 2025 1 commit
- [PD] Support logprob & Add failure test (#6558) · 8233cc10
  Byron Hsu authored May 23, 2025
  
  8233cc10
06 May, 2025 1 commit
- Better PD initialization (#5751) · a3e4e9bf
  Liangsheng Yin authored May 07, 2025
  
  a3e4e9bf
25 Apr, 2025 1 commit
- [PD]: Support Muti Prefill in one node (#5704) · 11e27d09
  IAN authored Apr 26, 2025
```
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
```
  11e27d09
21 Apr, 2025 2 commits
- [PD] Fix generate endpoint of min_lb for PD (#5598) · f29a718f
  shangmingc authored Apr 21, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  f29a718f
- Support PD bootstrap fields on /v1/chat/completions endpoint (#5488) · 3f57b00a
  Yongtong Wu authored Apr 21, 2025
  
  3f57b00a
20 Apr, 2025 1 commit
- [PD] Fix server crash when using batch requests (#5531) · 475e2e37
  fzyzcjy authored Apr 21, 2025
  
  475e2e37
19 Apr, 2025 1 commit
- [PD] Tiny fix timeout error when generate (#5545) · 569b032c
  fzyzcjy authored Apr 19, 2025
  
  569b032c
08 Apr, 2025 2 commits
- [PD] Simplify mini LB (#4911) · 6d3b35fa
  Byron Hsu authored Apr 08, 2025
```
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
```
  6d3b35fa
- [PD] Fix unclosed prefill connection warning of mini_lb (#5155) · 89a55418
  shangmingc authored Apr 09, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  89a55418
21 Mar, 2025 1 commit

[PD] Release initial code (#4654) · c7c7dbeb

Byron Hsu authored Mar 21, 2025


Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Ying1123 <sqy1415@gmail.com>
Co-authored-by: merrymercy <lianminzheng@gmail.com>
Co-authored-by: makro
Co-authored-by: dhou-xai

c7c7dbeb