Commits · 88a6f9dab5cc67b71d85a93a9d3f924879e33aa8 · zhaoyu6 / sglang · GitLab

14 Oct, 2025 1 commit
- bench_serving support PD Disaggregation (#11542) · 88a6f9da
  Xiaoyu Zhang authored Oct 14, 2025
  
  88a6f9da
13 Oct, 2025 1 commit
- ci: improve nightly-ci (#11385) · 0c0779d6
  Mick authored Oct 13, 2025
  
  0c0779d6
09 Oct, 2025 1 commit
- fix bench_serving mishandling of internal states (#11376) · fa7e2c30
  shaharmor98 authored Oct 09, 2025
```
Signed-off-by: Shahar Mor <smor@nvidia.com>
```
  fa7e2c30
08 Oct, 2025 2 commits
- benchmark: enhance configurable multimodal benchmarking in bench_serving (#9812) · e3bb7f5a
  Kevin Xiang Li authored Oct 08, 2025
```
Co-authored-by: Xiang (Kevin) Li <lik@nvidia.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  e3bb7f5a
- Support LoRA in bench_serving oai interface (#11318) · 92473e2e
  Lifu Huang authored Oct 08, 2025
  
  92473e2e
03 Oct, 2025 1 commit
- Tiny move files to utils folder (#11166) · fdc4e1e5
  fzyzcjy authored Oct 03, 2025
  
  fdc4e1e5
27 Sep, 2025 2 commits
- Add auth to get server info (#10751) · 51f7c6bd
  Muqi Li authored Sep 27, 2025
```
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  51f7c6bd
- [Bugfix][Minor][Benchmark] Fix some bugs due to PR #10495 (#10982) · bd95944c
  Muqi Li authored Sep 27, 2025
  
  bd95944c
26 Sep, 2025 1 commit
- ci: refactor nightly test (#10495) · 777eb538
  Mick authored Sep 27, 2025
  
  777eb538
18 Sep, 2025 1 commit
- [Feature] Speculative decoding support lookahead (#9873) · e7bc6003
  Zhihao Zhang authored Sep 19, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  e7bc6003
12 Sep, 2025 1 commit
- Benchmark: Support API_KEY without 'bearer' (#10380) · d5e2a374
  Muqi Li authored Sep 13, 2025
  
  d5e2a374
09 Sep, 2025 1 commit
- [CPU] Fix phi4-mm prompt issue in bench_serving (#9900) · 97fff98c
  blzheng authored Sep 09, 2025
  
  97fff98c
08 Sep, 2025 2 commits

fix: resolve lint issue (#10181) · 19d64f2b
Yineng Zhang authored Sep 08, 2025

19d64f2b

[Bench] feat: mooncake trace integration (#9839) · a02071a1

Teng Ma authored Sep 09, 2025


Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Signed-off-by: Teng Ma <sima.mt@alibaba-inc.com>
Co-authored-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>

a02071a1

27 Aug, 2025 1 commit

chore: enhance bench_serving for vlms with a new dataset of configurable image... · 16a6d21b

Mick authored Aug 27, 2025


chore: enhance bench_serving for vlms with a new dataset of configurable image count and resolution (#9583)
Co-authored-by: yhyang201 <yhyang201@gmail.com>

16a6d21b

15 Aug, 2025 1 commit
- fix: fix unsupported palette mode of images in bench_serving for mmmu (#9206) · 584e1ab2
  Mick authored Aug 15, 2025
  
  584e1ab2
08 Jul, 2025 1 commit
- [Multimodal][Perf] Use `pybase64` instead of `base64` (#7724) · a37e1247
  Brayden Zhong authored Jul 08, 2025
  
  a37e1247
30 Jun, 2025 1 commit
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
28 Jun, 2025 1 commit

oai: Adds support for OpenAI chat completions API in bench_serving (#7036) · c45e49d8

Xinyuan Tong authored Jun 28, 2025


Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>

c45e49d8

11 Jun, 2025 1 commit
- Support VILA models (#6106) · 31d6dee5
  Zijian authored Jun 12, 2025
  
  31d6dee5
07 Jun, 2025 1 commit
- [Refactor] image data process in bench_serving (#6879) · 697b0f71
  Xinyuan Tong authored Jun 06, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  697b0f71
31 May, 2025 1 commit
- [FIX] mmmu bench serving result display error (#6525) (#6791) · fb507b7b
  Yikai Zhang authored Jun 01, 2025
  
  fb507b7b
30 May, 2025 1 commit
- Fix aiohttp 'Chunk too big' in bench_serving (#6737) · d279d499
  Yuhong Guo authored May 30, 2025
  
  d279d499
26 May, 2025 4 commits
- Tiny fix CI (#6611) · 501efc3d
  fzyzcjy authored May 26, 2025
  
  501efc3d
- Support accurate length control for bench serving (#6594) · 6bebef60
  fzyzcjy authored May 26, 2025
  
  6bebef60
- Auto handle PD disaggregation in bench_serving (#6587) · 25be63d0
  fzyzcjy authored May 26, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  25be63d0
- Fix bench_serving does not support changing warmup requests (#6439) · 2c3a6fe1
  fzyzcjy authored May 26, 2025
  
  2c3a6fe1
22 May, 2025 2 commits
- misc: fix accept_length (#6536) · a6970a17
  Yineng Zhang authored May 22, 2025
  
  a6970a17
- Recover from corrupted cache file in bench serving (#6510) · 969660c7
  fzyzcjy authored May 22, 2025
  
  969660c7
21 May, 2025 1 commit
- Let bench_one_batch_server use sharegpt data to make expert distribution more natural (#5573) · 7222e1da
  fzyzcjy authored May 21, 2025
  
  7222e1da
18 May, 2025 3 commits
- Tiny refactor bench_serving to extract RequestFuncOutput.init_new (#6108) · 26ebb849
  fzyzcjy authored May 18, 2025
  
  26ebb849
- Tiny refactor bench_serving to improve extensibility (#6134) · 02973cd9
  fzyzcjy authored May 18, 2025
  
  02973cd9
- Support outputing details for bench_serving (#6107) · 6d95a35a
  fzyzcjy authored May 18, 2025
  
  6d95a35a
12 May, 2025 2 commits
- fix typo (#6248) · f24fc5b8
  Yineng Zhang authored May 12, 2025
  
  f24fc5b8
- Log if cuda graph is used & extend cuda graph capture to cuda-graph-max-bs (#6201) · fba8eccd
  Lianmin Zheng authored May 12, 2025
```
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
```
  fba8eccd
11 May, 2025 1 commit
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
08 May, 2025 1 commit
- [CI]Add performance CI for VLM (#6038) · e88dd482
  XinyuanTong authored May 07, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  e88dd482
27 Apr, 2025 2 commits
- [CI] fix port conflicts (#5789) · 35ca04d2
  Lianmin Zheng authored Apr 27, 2025
  
  35ca04d2
- fix: Use `is not None` instead of `!= None` for None checks. (#5687) · 094891c0
  vzed authored Apr 26, 2025
  
  094891c0
23 Apr, 2025 1 commit
- fix: update truss bench_serving (#5683) · b1f6d89b
  Yineng Zhang authored Apr 23, 2025
  
  b1f6d89b