Commits · 013abde6ef02e55abb393d3baff855eea9693479 · OpenDAS / vllm_cscc · GitLab

16 Oct, 2025 2 commits
- Adding Warmup to Benchmark Serving (#26943) · 013abde6
  kimbochen authored Oct 16, 2025
```
Signed-off-by: Kimbo Chen <chentenghung@gmail.com>
```
  013abde6
- [Benchmark] Show E2EL by default for pooling models (#27014) · 334535b6
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  334535b6
15 Oct, 2025 1 commit
- [Feature] default --extra-body param to disable thinking in vllm bench serve (#26784) · a27b288e
  rongfu.leng authored Oct 15, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  a27b288e
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- [Misc] Upgrade more code to Python 3.10 (#26463) · dc7976dd
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dc7976dd
06 Oct, 2025 1 commit
- [Benchmark] Enable MM Embedding benchmarks (#26310) · 44b9af5b
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44b9af5b
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
03 Oct, 2025 1 commit
- [Misc] Add penalties sampling parameters to serve tool (#25974) · b71fcd49
  Sergei Skvortsov authored Oct 03, 2025
```
Signed-off-by: Sergei Skvortsov <sergeyskv@nebius.com>
Co-authored-by: Sergei Skvortsov <sergeyskv@nebius.com>
```
  b71fcd49
01 Oct, 2025 1 commit
- [Benchmark] Finish documented v0.11.0 deprecation of --endpoint-type (#26007) · f9e71481
  Nathan Scott authored Oct 01, 2025
```
Signed-off-by: Nathan Scott <nathans@redhat.com>
```
  f9e71481
23 Sep, 2025 1 commit

[benchmarks]allow skip ready check for bench serve (#25420) · eea17839

Lucia Fang authored Sep 22, 2025


Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>

eea17839

18 Sep, 2025 2 commits
- [Misc] Clean up flags in `vllm bench serve` (#25138) · 21da7334
  Roger Wang authored Sep 18, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  21da7334
- [benchmark] add peak throughput metrics and plot (#23867) · a904ea78
  Simon Mo authored Sep 17, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  a904ea78
17 Sep, 2025 1 commit
- [Docs] improve code formatting and comments for eliminate griffe build warning. (#25010) · 47f670b0
  samzong authored Sep 17, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  47f670b0
12 Sep, 2025 1 commit
- [Benchmark] Allow arbitrary headers to be passed to benchmarked endpoints (#23937) · bc636f21
  Clayton Coleman authored Sep 12, 2025
```
Signed-off-by: Clayton Coleman <smarterclayton@gmail.com>
```
  bc636f21
03 Sep, 2025 1 commit
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
26 Aug, 2025 1 commit
- [Benchmarks] add benchmark for embedding models (#23000) · 3ecbb14b
  Jiangyun Zhu authored Aug 26, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  3ecbb14b
19 Aug, 2025 1 commit
- [Misc] Add request_id into benchmark_serve.py (#23065) · 31436e8b
  hustxiayang authored Aug 19, 2025
```
Signed-off-by: yangxia <yangxiast@gmail.com>
```
  31436e8b
10 Aug, 2025 1 commit
- Fix(benchmarks): allow multiple mm contents in OpenAI Chat Completion Benchmarks (#22534) · 65a7917b
  Breno Baldas Skuk authored Aug 10, 2025
```
Signed-off-by: breno.skuk <breno.skuk@hcompany.ai>
```
  65a7917b
08 Aug, 2025 1 commit
- [bench] Fix benchmark/serve.py to ignore unavailable results (#22382) · 808a7b69
  lkchen authored Aug 07, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  808a7b69
07 Aug, 2025 1 commit
- [Bench] Split serve.py:main into async/async versions (#22405) · 4d4297e8
  lkchen authored Aug 06, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  4d4297e8
04 Aug, 2025 1 commit
- Use `aiohttp` connection pool for benchmarking (#21981) · 6f547829
  Seiji Eicher authored Aug 03, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  6f547829
03 Aug, 2025 1 commit
- [Benchmark] Support ready check timeout in `vllm bench serve` (#21696) · 3f36c325
  Ye (Charlotte) Qi authored Aug 03, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  3f36c325
30 Jul, 2025 1 commit
- [benchmark] add max-concurrency in result table (#21095) · 533db093
  Peter Pan authored Jul 30, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  533db093
28 Jul, 2025 1 commit
- [bugfix] fix profile impact benchmark results (#21507) · 18cc33dd
  rongfu.leng authored Jul 28, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  18cc33dd
22 Jul, 2025 1 commit
- [benchmark] Port benchmark request sent optimization to benchmark_serving (#21209) · 10904e6d
  Jialin Ouyang authored Jul 22, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  10904e6d
18 Jul, 2025 1 commit
- [benchmark] Sending request strictly follows the random intervals (#21108) · 1bf65138
  Jialin Ouyang authored Jul 17, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  1bf65138
01 Jul, 2025 1 commit
- [Misc] remove redundant char (#20287) · b1c1fe35
  Kebe authored Jul 01, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  b1c1fe35
26 Jun, 2025 1 commit
- [Benchmark][Bug] Fix multiple bugs in bench and add args to spec_decode offline (#20083) · 9502c381
  Ekagra Ranjan authored Jun 26, 2025
  
  9502c381
24 Jun, 2025 1 commit

[Misc][Benchmarking] Add variable request-rate ("ramp-up") to the benchmarking client. (#19423) · c635c5f7

d.transposed authored Jun 24, 2025

Signed-off-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: Roger Wang <hey@rogerw.me>

c635c5f7

12 Jun, 2025 1 commit
- [Spec Decode][Benchmark] Generalize spec decode offline benchmark to more... · 017ef648
  Ekagra Ranjan authored Jun 12, 2025
```
[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847)
```
  017ef648
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
31 May, 2025 1 commit
- [Misc][Benchmark] Add support for CustomDataset (#18511) · bbfa0c61
  Ekagra Ranjan authored May 31, 2025
  
  bbfa0c61
27 May, 2025 1 commit
- Support datasets in `vllm bench serve` and sync with benchmark_[serving,datasets].py (#18566) · e56f44d9
  Michael Goin authored May 27, 2025
  
  e56f44d9
09 Apr, 2025 1 commit
- [BugFix] fix some typos found by typos. (#16314) · 04149cce
  yihong authored Apr 09, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  04149cce
28 Mar, 2025 1 commit
- [Misc] cli auto show default value (#15582) · 26df46ee
  Reid authored Mar 29, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  26df46ee
12 Mar, 2025 1 commit

[Feature] Add `vllm bench` CLI (#13993) · 36e0c8f7

Randy Chen authored Mar 11, 2025


Signed-off-by: Randy Chen <acad.randyjhc@gmail.com>
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

36e0c8f7

10 Mar, 2025 1 commit

[Feature] Consolidate performance benchmark datasets (#14036) · 1253b157

Jennifer Zhao authored Mar 10, 2025


Signed-off-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

1253b157

07 Mar, 2025 1 commit
- [Doc] Fix a typo (#14385) · ad60bbb2
  Daniel Li authored Mar 06, 2025
  
  ad60bbb2
05 Mar, 2025 1 commit

Deprecate `best_of` Sampling Parameter in anticipation for vLLM V1 (#13997) · a4f1ee35

Vincent authored Mar 05, 2025

Signed-off-by: vincent-4 <vincentzhongy+githubvincent4@gmail.com>
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

a4f1ee35

03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8