Commits · de9cb617637deabab4e34db05d26c8d4d6b2ed98 · OpenDAS / vllm_cscc · GitLab

16 Aug, 2025 1 commit
- Add docs for PrefixRepetitionDataset + enable usage with `vllm bench throughput` (#23012) · de9cb617
  Seiji Eicher authored Aug 16, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  de9cb617
15 Aug, 2025 2 commits
- Add PrefixRepetitionRandomDataset to `vllm bench serve` datasets (#20638) · 00d6cba0
  Seiji Eicher authored Aug 15, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  00d6cba0
- [Benchmarks] Include image data when ShareGPT4V dataset is used. (#22955) · 993d3d12
  Chenheli Hua authored Aug 15, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  993d3d12
11 Aug, 2025 1 commit
- [Docs] Add comprehensive CLI reference for all large `vllm` subcommands (#22601) · bc1d02ac
  Harry Mellor authored Aug 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bc1d02ac
10 Aug, 2025 1 commit
- Fix(benchmarks): allow multiple mm contents in OpenAI Chat Completion Benchmarks (#22534) · 65a7917b
  Breno Baldas Skuk authored Aug 10, 2025
```
Signed-off-by: breno.skuk <breno.skuk@hcompany.ai>
```
  65a7917b
08 Aug, 2025 1 commit
- [bench] Fix benchmark/serve.py to ignore unavailable results (#22382) · 808a7b69
  lkchen authored Aug 07, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  808a7b69
07 Aug, 2025 2 commits
- [Bench] Split serve.py:main into async/async versions (#22405) · 4d4297e8
  lkchen authored Aug 06, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  4d4297e8
- preload heavy modules when mp method is forkserver (#22214) · ad6c655d
  Lionel Villard authored Aug 06, 2025
```
Signed-off-by: Lionel Villard <villard@us.ibm.com>
```
  ad6c655d
04 Aug, 2025 1 commit
- Use `aiohttp` connection pool for benchmarking (#21981) · 6f547829
  Seiji Eicher authored Aug 03, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  6f547829
03 Aug, 2025 1 commit
- [Benchmark] Support ready check timeout in `vllm bench serve` (#21696) · 3f36c325
  Ye (Charlotte) Qi authored Aug 03, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  3f36c325
30 Jul, 2025 1 commit
- [benchmark] add max-concurrency in result table (#21095) · 533db093
  Peter Pan authored Jul 30, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  533db093
28 Jul, 2025 1 commit
- [bugfix] fix profile impact benchmark results (#21507) · 18cc33dd
  rongfu.leng authored Jul 28, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  18cc33dd
27 Jul, 2025 1 commit
- Handle non-serializable objects in vllm bench (#21665) · 971948b8
  Huy Do authored Jul 26, 2025
  
  971948b8
25 Jul, 2025 1 commit
- [Frontend] `run-batch` supports V1 (#21541) · 34ddcf9f
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34ddcf9f
22 Jul, 2025 1 commit
- [benchmark] Port benchmark request sent optimization to benchmark_serving (#21209) · 10904e6d
  Jialin Ouyang authored Jul 22, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  10904e6d
18 Jul, 2025 1 commit
- [benchmark] Sending request strictly follows the random intervals (#21108) · 1bf65138
  Jialin Ouyang authored Jul 17, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  1bf65138
14 Jul, 2025 1 commit
- Add benchmark dataset for mlperf llama tasks (#20338) · 8bb43b9c
  Michael Goin authored Jul 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  8bb43b9c
09 Jul, 2025 1 commit
- [Benchmark] Parameterization of streaming loading of multimodal datasets (#20528) · 9ff2af6d
  Li Wang authored Jul 09, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
  9ff2af6d
01 Jul, 2025 1 commit
- [Misc] remove redundant char (#20287) · b1c1fe35
  Kebe authored Jul 01, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  b1c1fe35
26 Jun, 2025 1 commit
- [Benchmark][Bug] Fix multiple bugs in bench and add args to spec_decode offline (#20083) · 9502c381
  Ekagra Ranjan authored Jun 26, 2025
  
  9502c381
24 Jun, 2025 1 commit

[Misc][Benchmarking] Add variable request-rate ("ramp-up") to the benchmarking client. (#19423) · c635c5f7

d.transposed authored Jun 24, 2025

Signed-off-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: Roger Wang <hey@rogerw.me>

c635c5f7

22 Jun, 2025 1 commit

[Benchmark] fix request loss if "ping" is returned (#19535) · 202c5df9

Wang, Yi authored Jun 22, 2025


Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

202c5df9

20 Jun, 2025 1 commit
- [Benchmark] Fix `Value of type "SampleRequest" is not indexable` (#18032) · 5aa4a015
  Brayden Zhong authored Jun 20, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  5aa4a015
12 Jun, 2025 1 commit
- [Spec Decode][Benchmark] Generalize spec decode offline benchmark to more... · 017ef648
  Ekagra Ranjan authored Jun 12, 2025
```
[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847)
```
  017ef648
04 Jun, 2025 1 commit
- [Misc] Add packages for benchmark as extra dependency (#19089) · 8711bc5e
  Isotr0py authored Jun 04, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  8711bc5e
03 Jun, 2025 3 commits
- [V1][Spec Decode][Ngram] 1.35x gain -> 1.95x gain on InstructCoder with prompt fix (#18971) · 135cf55c
  Ekagra Ranjan authored Jun 03, 2025
  
  135cf55c
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- Reduce logs in CLI scripts and plugin loader (#18970) · cc977286
  Michael Goin authored Jun 03, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cc977286
31 May, 2025 1 commit
- [Misc][Benchmark] Add support for CustomDataset (#18511) · bbfa0c61
  Ekagra Ranjan authored May 31, 2025
  
  bbfa0c61
28 May, 2025 2 commits
- [V1] fix torch profiling for V1 offline scenarios (#18445) · 774c5fde
  Divakar Verma authored May 27, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  774c5fde
- [Bugfix] Disable prefix caching by default for benchmark (#18771) · 51e98e4f
  cascade authored May 27, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  51e98e4f
27 May, 2025 2 commits
- Support datasets in `vllm bench serve` and sync with benchmark_[serving,datasets].py (#18566) · e56f44d9
  Michael Goin authored May 27, 2025
  
  e56f44d9
- Disable prefix cache by default for benchmark (#18639) · aaa4ac1c
  cascade authored May 27, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  aaa4ac1c
23 May, 2025 2 commits
- [Doc] Fix top-level API links/docs (#18621) · 273cb3b4
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  273cb3b4
- Re-submit: Fix: Proper RGBA -> RGB conversion for PIL images. (#18569) · 04eb88dc
  Chenheli Hua authored May 22, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  04eb88dc
12 May, 2025 1 commit
- [Fix] Benchmark `"EngineClient" has no attribute "model_config"` (#17976) · 891b9d33
  Brayden Zhong authored May 12, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  891b9d33
06 May, 2025 1 commit

[Misc] Add Next Edit Prediction (NEP) datasets support in `benchmark_serving.py` (#16839) · d456aea7

d.transposed authored May 06, 2025

Signed-off-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Signed-off-by: dtransposed <>
Co-authored-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>

d456aea7

25 Apr, 2025 1 commit
- Fix Python packaging edge cases (#17159) · 65e262b9
  Christian Heimes authored Apr 26, 2025
```
Signed-off-by: Christian Heimes <christian@python.org>
```
  65e262b9
15 Apr, 2025 1 commit
- Add `vllm bench [latency, throughput]` CLI commands (#16508) · b4fe16c7
  Michael Goin authored Apr 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b4fe16c7
09 Apr, 2025 1 commit
- [BugFix] fix some typos found by typos. (#16314) · 04149cce
  yihong authored Apr 09, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  04149cce