Commits · f7f9e41b3619083ab0f07d551cd55bb1e8b321d3 · change / sglang · GitLab

31 Oct, 2025 3 commits
- Fix run benchmark (#12473) · f7f9e41b
  Ke Bao authored Nov 01, 2025
  
  f7f9e41b
- add served model name in bench serving (#12428) · cf0c2415
  carolove authored Nov 01, 2025
  
  cf0c2415
- fix: Add default value for backend in sample_mmmu_requests (#12256) · 50b6842b
  Zaili Wang authored Oct 31, 2025
  
  50b6842b
30 Oct, 2025 2 commits
- Super tiny fix AMD ci (#12378) · fb52d35f
  fzyzcjy authored Oct 30, 2025
  
  fb52d35f
- Super tiny add tag for benchmark scripts (#12340) · 25c50498
  fzyzcjy authored Oct 30, 2025
  
  25c50498
26 Oct, 2025 1 commit
- Fix ITL metrics when using openai endpoint with spec (#12156) · ea385ae8
  Liangsheng Yin authored Oct 26, 2025
  
  ea385ae8
24 Oct, 2025 2 commits
- fix: bench_serving ITL calculation when using spec-decoding (#12064) · b9fb74f3
  Xinyuan Tong authored Oct 24, 2025
  
  b9fb74f3
- fix: fix MMMU loading issue (#11759) · 92009bd2
  Zaili Wang authored Oct 24, 2025
```
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  92009bd2
21 Oct, 2025 1 commit
- vlm: enforce pybase64 for image and str encode/decode (#10700) · d0a64c7e
  b8zhong authored Oct 21, 2025
  
  d0a64c7e
14 Oct, 2025 1 commit
- bench_serving support PD Disaggregation (#11542) · 88a6f9da
  Xiaoyu Zhang authored Oct 14, 2025
  
  88a6f9da
13 Oct, 2025 1 commit
- ci: improve nightly-ci (#11385) · 0c0779d6
  Mick authored Oct 13, 2025
  
  0c0779d6
09 Oct, 2025 1 commit
- fix bench_serving mishandling of internal states (#11376) · fa7e2c30
  shaharmor98 authored Oct 09, 2025
```
Signed-off-by: Shahar Mor <smor@nvidia.com>
```
  fa7e2c30
08 Oct, 2025 2 commits
- benchmark: enhance configurable multimodal benchmarking in bench_serving (#9812) · e3bb7f5a
  Kevin Xiang Li authored Oct 08, 2025
```
Co-authored-by: Xiang (Kevin) Li <lik@nvidia.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  e3bb7f5a
- Support LoRA in bench_serving oai interface (#11318) · 92473e2e
  Lifu Huang authored Oct 08, 2025
  
  92473e2e
03 Oct, 2025 1 commit
- Tiny move files to utils folder (#11166) · fdc4e1e5
  fzyzcjy authored Oct 03, 2025
  
  fdc4e1e5
27 Sep, 2025 2 commits
- Add auth to get server info (#10751) · 51f7c6bd
  Muqi Li authored Sep 27, 2025
```
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
```
  51f7c6bd
- [Bugfix][Minor][Benchmark] Fix some bugs due to PR #10495 (#10982) · bd95944c
  Muqi Li authored Sep 27, 2025
  
  bd95944c
26 Sep, 2025 1 commit
- ci: refactor nightly test (#10495) · 777eb538
  Mick authored Sep 27, 2025
  
  777eb538
18 Sep, 2025 1 commit
- [Feature] Speculative decoding support lookahead (#9873) · e7bc6003
  Zhihao Zhang authored Sep 19, 2025
```
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
```
  e7bc6003
12 Sep, 2025 1 commit
- Benchmark: Support API_KEY without 'bearer' (#10380) · d5e2a374
  Muqi Li authored Sep 13, 2025
  
  d5e2a374
09 Sep, 2025 1 commit
- [CPU] Fix phi4-mm prompt issue in bench_serving (#9900) · 97fff98c
  blzheng authored Sep 09, 2025
  
  97fff98c
08 Sep, 2025 2 commits

fix: resolve lint issue (#10181) · 19d64f2b
Yineng Zhang authored Sep 08, 2025

19d64f2b

[Bench] feat: mooncake trace integration (#9839) · a02071a1

Teng Ma authored Sep 09, 2025


Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Signed-off-by: Teng Ma <sima.mt@alibaba-inc.com>
Co-authored-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>

a02071a1

27 Aug, 2025 1 commit

chore: enhance bench_serving for vlms with a new dataset of configurable image... · 16a6d21b

Mick authored Aug 27, 2025


chore: enhance bench_serving for vlms with a new dataset of configurable image count and resolution (#9583)
Co-authored-by: yhyang201 <yhyang201@gmail.com>

16a6d21b

15 Aug, 2025 1 commit
- fix: fix unsupported palette mode of images in bench_serving for mmmu (#9206) · 584e1ab2
  Mick authored Aug 15, 2025
  
  584e1ab2
08 Jul, 2025 1 commit
- [Multimodal][Perf] Use `pybase64` instead of `base64` (#7724) · a37e1247
  Brayden Zhong authored Jul 08, 2025
  
  a37e1247
30 Jun, 2025 1 commit
- Improve streaming, log_level, memory report, weight loading, and benchmark script (#7632) · 22352d47
  Lianmin Zheng authored Jun 29, 2025
```
Co-authored-by: Kan Wu <wukanustc@gmail.com>
```
  22352d47
28 Jun, 2025 1 commit

oai: Adds support for OpenAI chat completions API in bench_serving (#7036) · c45e49d8

Xinyuan Tong authored Jun 28, 2025


Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>

c45e49d8

11 Jun, 2025 1 commit
- Support VILA models (#6106) · 31d6dee5
  Zijian authored Jun 12, 2025
  
  31d6dee5
07 Jun, 2025 1 commit
- [Refactor] image data process in bench_serving (#6879) · 697b0f71
  Xinyuan Tong authored Jun 06, 2025
```
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
```
  697b0f71
31 May, 2025 1 commit
- [FIX] mmmu bench serving result display error (#6525) (#6791) · fb507b7b
  Yikai Zhang authored Jun 01, 2025
  
  fb507b7b
30 May, 2025 1 commit
- Fix aiohttp 'Chunk too big' in bench_serving (#6737) · d279d499
  Yuhong Guo authored May 30, 2025
  
  d279d499
26 May, 2025 4 commits
- Tiny fix CI (#6611) · 501efc3d
  fzyzcjy authored May 26, 2025
  
  501efc3d
- Support accurate length control for bench serving (#6594) · 6bebef60
  fzyzcjy authored May 26, 2025
  
  6bebef60
- Auto handle PD disaggregation in bench_serving (#6587) · 25be63d0
  fzyzcjy authored May 26, 2025
```
Co-authored-by: yizhang2077 <1109276519@qq.com>
```
  25be63d0
- Fix bench_serving does not support changing warmup requests (#6439) · 2c3a6fe1
  fzyzcjy authored May 26, 2025
  
  2c3a6fe1
22 May, 2025 2 commits
- misc: fix accept_length (#6536) · a6970a17
  Yineng Zhang authored May 22, 2025
  
  a6970a17
- Recover from corrupted cache file in bench serving (#6510) · 969660c7
  fzyzcjy authored May 22, 2025
  
  969660c7
21 May, 2025 1 commit
- Let bench_one_batch_server use sharegpt data to make expert distribution more natural (#5573) · 7222e1da
  fzyzcjy authored May 21, 2025
  
  7222e1da
18 May, 2025 1 commit
- Tiny refactor bench_serving to extract RequestFuncOutput.init_new (#6108) · 26ebb849
  fzyzcjy authored May 18, 2025
  
  26ebb849