Commits · de111f32461bf751851c175af59e913fafaa16d1 · OpenDAS / vllm_cscc

16 Apr, 2026 1 commit
- [Bugfix] Fix bench_serve UTF-8 decode crash on split multi-byte chars (#38732) · de111f32
  Yufeng He authored Apr 17, 2026
  
  de111f32
14 Apr, 2026 1 commit
- [Bugfix] Fix `vllm bench serve` to count multimodal tokens in "total input tokens" (#38654) · 1e4748c6
  Matthias Gehre authored Apr 14, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  1e4748c6
09 Mar, 2026 1 commit
- [Bug] Fix pooling model benchmark script (#36300) · be292b7c
  Wentao Ye authored Mar 09, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  be292b7c
10 Feb, 2026 1 commit
- Support benchmarking of Geospatial models (#33922) · 599e4335
  mgazz authored Feb 10, 2026
```
Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
```
  599e4335
09 Feb, 2026 1 commit

[ASR] Fix audio benchmark and add RTFx metric (#32300) · 1d5922fa

Ekagra Ranjan authored Feb 09, 2026


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

1d5922fa

01 Feb, 2026 1 commit
- fix: only include Authorization header when OPENAI_API_KEY is set (#33488) · 754a8ca9
  Zack Yu authored Jan 31, 2026
```
Signed-off-by: zack041 <zackyu041@gmail.com>
```
  754a8ca9
22 Jan, 2026 1 commit
- [Benchmark] Don't default to `temperature==0` in `vllm bench serve` (#32723) · 098b2d66
  Nick Hill authored Jan 22, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  098b2d66
24 Oct, 2025 1 commit
- [Benchmark] Enable benchmark to run with `encoding_format="bytes"` (#27467) · b7030d96
  Cyrus Leung authored Oct 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b7030d96
16 Oct, 2025 1 commit
- [Benchmark] Use truncation by default for pooling benchmarks (#26992) · 17838e50
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  17838e50
14 Oct, 2025 1 commit
- Add support for the /rerank endpoint in vllm bench serve (#26602) · fe3edb4c
  Maximilien de Bayser authored Oct 14, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  fe3edb4c
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
11 Oct, 2025 1 commit
- [Benchmark] Support Infinity API (#26641) · 5be7ca1b
  Cyrus Leung authored Oct 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5be7ca1b
06 Oct, 2025 1 commit
- [Benchmark] Enable MM Embedding benchmarks (#26310) · 44b9af5b
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44b9af5b
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
19 Sep, 2025 1 commit
- refactor(benchmarks): add type annotations to wait_for_endpoint parameters (#25218) · ce75e153
  samzong authored Sep 20, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  ce75e153
18 Sep, 2025 1 commit
- [benchmark] add peak throughput metrics and plot (#23867) · a904ea78
  Simon Mo authored Sep 17, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  a904ea78
12 Sep, 2025 1 commit
- [Benchmark] Allow arbitrary headers to be passed to benchmarked endpoints (#23937) · bc636f21
  Clayton Coleman authored Sep 12, 2025
```
Signed-off-by: Clayton Coleman <smarterclayton@gmail.com>
```
  bc636f21
09 Sep, 2025 1 commit
- [Misc] Support bench serve long context (#24373) · 1823a00d
  Ming Yang authored Sep 08, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  1823a00d
26 Aug, 2025 1 commit
- [Benchmarks] add benchmark for embedding models (#23000) · 3ecbb14b
  Jiangyun Zhu authored Aug 26, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  3ecbb14b
21 Aug, 2025 1 commit

[BugFix] Fix Python 3.9 Support (#23306) · 31282401

Jared O'Connell authored Aug 21, 2025

Signed-off-by: Jared O'Connell <46976761+jaredoconnell@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

31282401

19 Aug, 2025 1 commit
- [Misc] Add request_id into benchmark_serve.py (#23065) · 31436e8b
  hustxiayang authored Aug 19, 2025
```
Signed-off-by: yangxia <yangxiast@gmail.com>
```
  31436e8b
10 Aug, 2025 1 commit
- Fix(benchmarks): allow multiple mm contents in OpenAI Chat Completion Benchmarks (#22534) · 65a7917b
  Breno Baldas Skuk authored Aug 10, 2025
```
Signed-off-by: breno.skuk <breno.skuk@hcompany.ai>
```
  65a7917b
04 Aug, 2025 1 commit
- Use `aiohttp` connection pool for benchmarking (#21981) · 6f547829
  Seiji Eicher authored Aug 03, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  6f547829
03 Aug, 2025 1 commit
- [Benchmark] Support ready check timeout in `vllm bench serve` (#21696) · 3f36c325
  Ye (Charlotte) Qi authored Aug 03, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  3f36c325
22 Jun, 2025 1 commit

[Benchmark] fix request loss if "ping" is returned (#19535) · 202c5df9

Wang, Yi authored Jun 22, 2025


Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

202c5df9

03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
27 May, 2025 1 commit
- Support datasets in `vllm bench serve` and sync with benchmark_[serving,datasets].py (#18566) · e56f44d9
  Michael Goin authored May 27, 2025
  
  e56f44d9
12 Mar, 2025 1 commit

[Feature] Add `vllm bench` CLI (#13993) · 36e0c8f7

Randy Chen authored Mar 11, 2025


Signed-off-by: Randy Chen <acad.randyjhc@gmail.com>
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

36e0c8f7