Commits · 38d8096760cd8f42fb65fc0ba2b9fb11f98d8ac3 · OpenDAS / vllm_cscc

09 Sep, 2025 1 commit
- [CI/Build][Doc] Fully deprecate old bench scripts for serving / throughput / latency (#24411) · 6fb27881
  Ye (Charlotte) Qi authored Sep 09, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  6fb27881
03 Sep, 2025 1 commit
- [Doc]: fix typos in Python comments (#24115) · 02d411fd
  Didier Durand authored Sep 03, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  02d411fd
19 Aug, 2025 1 commit
- [Misc] Add request_id into benchmark_serve.py (#23065) · 31436e8b
  hustxiayang authored Aug 19, 2025
```
Signed-off-by: yangxia <yangxiast@gmail.com>
```
  31436e8b
10 Aug, 2025 1 commit
- Fix(benchmarks): allow multiple mm contents in OpenAI Chat Completion Benchmarks (#22534) · 65a7917b
  Breno Baldas Skuk authored Aug 10, 2025
```
Signed-off-by: breno.skuk <breno.skuk@hcompany.ai>
```
  65a7917b
02 Aug, 2025 1 commit
- docs: remove deprecated disable-log-requests flag (#22113) · 067c34a1
  Roger Wang authored Aug 02, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
```
  067c34a1
30 Jul, 2025 1 commit
- [benchmark] add max-concurrency in result table (#21095) · 533db093
  Peter Pan authored Jul 30, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  533db093
28 Jul, 2025 1 commit
- [bugfix] fix profile impact benchmark results (#21507) · 18cc33dd
  rongfu.leng authored Jul 28, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  18cc33dd
26 Jul, 2025 1 commit
- [CI/Build][Doc] Move existing benchmark scripts in CI/document/example to vllm bench CLI (#21355) · e7c4f9ee
  Ye (Charlotte) Qi authored Jul 26, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  e7c4f9ee
22 Jul, 2025 1 commit
- [benchmark] Port benchmark request sent optimization to benchmark_serving (#21209) · 10904e6d
  Jialin Ouyang authored Jul 22, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  10904e6d
09 Jul, 2025 1 commit
- [Benchmark] Parameterization of streaming loading of multimodal datasets (#20528) · 9ff2af6d
  Li Wang authored Jul 09, 2025
```
Signed-off-by: wangli <wangli858794774@gmail.com>
```
  9ff2af6d
01 Jul, 2025 1 commit
- [Misc] remove redundant char (#20287) · b1c1fe35
  Kebe authored Jul 01, 2025
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  b1c1fe35
24 Jun, 2025 1 commit

[Misc][Benchmarking] Add variable request-rate ("ramp-up") to the benchmarking client. (#19423) · c635c5f7

d.transposed authored Jun 24, 2025

Signed-off-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: Roger Wang <hey@rogerw.me>

c635c5f7

14 Jun, 2025 1 commit
- [Misc] Modularize CLI Argument Parsing in Benchmark Scripts (#19593) · 6fa718a4
  Reid authored Jun 14, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
```
  6fa718a4
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
31 May, 2025 1 commit
- [Misc][Benchmark] Add support for CustomDataset (#18511) · bbfa0c61
  Ekagra Ranjan authored May 31, 2025
  
  bbfa0c61
29 May, 2025 1 commit
- [Misc][Tools][Benchmark] Add benchmark_serving supports for llama.cpp. (#18692) · b169d5f7
  Duyi-Wang authored May 29, 2025
```
Signed-off-by: Duyi-Wang <duyi.wang@intel.com>
```
  b169d5f7
13 May, 2025 1 commit
- Convert `benchmarks` to `ruff format` (#18068) · 009d9e75
  Harry Mellor authored May 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  009d9e75
06 May, 2025 1 commit

[Misc] Add Next Edit Prediction (NEP) datasets support in `benchmark_serving.py` (#16839) · d456aea7

d.transposed authored May 06, 2025

Signed-off-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Signed-off-by: dtransposed <>
Co-authored-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>

d456aea7

28 Apr, 2025 1 commit
- [Benchmark] Add single turn MTBench to Serving Bench (#17202) · cfe45320
  Ekagra Ranjan authored Apr 28, 2025
  
  cfe45320
25 Apr, 2025 1 commit
- [Misc] Benchmark Serving Script Support Appending Results (#17028) · 881f7358
  Lucas Wilkinson authored Apr 25, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  881f7358
19 Apr, 2025 1 commit
- [Misc] Benchmarks for audio models (#16505) · 9d4ca19d
  Nicolò Lucchesi authored Apr 19, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  9d4ca19d
10 Apr, 2025 2 commits
- Fix range_ratio Bug in RandomDataset (#16126) · 268c3250
  WWW authored Apr 11, 2025
```
Signed-off-by: jadewang21 <jadewangcn@outlook.com>
```
  268c3250
- [Bugfix] Fix output token length check logic (#16419) · 7cd0bd72
  look authored Apr 11, 2025
```
Signed-off-by: look <eeslook@163.com>
```
  7cd0bd72
09 Apr, 2025 1 commit
- [BugFix] fix some typos found by typos. (#16314) · 04149cce
  yihong authored Apr 09, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  04149cce
06 Apr, 2025 1 commit
- [Benchmark] Add sampling parameters to benchmark_serving. (#16022) · ba108019
  Hyesoo Yang authored Apr 05, 2025
```
Signed-off-by: Hyesoo Yang <hyeygit@gmail.com>
```
  ba108019
03 Apr, 2025 1 commit

[Benchmark] Add AIMO Dataset to Benchmark (#15955) · 06f21ce7

Ziji Shi (Steven) authored Apr 02, 2025


Signed-off-by: Ziji Shi <shi.ziji.sm@gmail.com>
Signed-off-by: StevenShi-23 <shi.ziji.sm@gmail.com>

06f21ce7

02 Apr, 2025 1 commit

[Benchmark]Fix error message (#15866) · aa557e64

Li Wang authored Apr 02, 2025


Signed-off-by: wangli <wangli858794774@gmail.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

aa557e64

31 Mar, 2025 1 commit
- [Benchmark] Update Vision Arena Dataset and HuggingFaceDataset Setup (#15748) · effc5d24
  Jennifer Zhao authored Mar 31, 2025
```
Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
```
  effc5d24
28 Mar, 2025 2 commits
- [Minor] Remove TGI launching script (#15646) · 70e13224
  Woosuk Kwon authored Mar 28, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  70e13224
- [Misc]add coding benchmark for speculative decoding (#15303) · e7f720ea
  Chen Xia authored Mar 27, 2025
```
Signed-off-by: CXIAAAAA <cxia0209@gmail.com>
```
  e7f720ea
17 Mar, 2025 1 commit
- [Benchmark] Do not save detailed info to json by default (#14879) · 583a9778
  Simon Mo authored Mar 16, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  583a9778
10 Mar, 2025 1 commit

[Feature] Consolidate performance benchmark datasets (#14036) · 1253b157

Jennifer Zhao authored Mar 10, 2025


Signed-off-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

1253b157

07 Mar, 2025 1 commit
- [Doc] Fix a typo (#14385) · ad60bbb2
  Daniel Li authored Mar 06, 2025
  
  ad60bbb2
05 Mar, 2025 1 commit

Deprecate `best_of` Sampling Parameter in anticipation for vLLM V1 (#13997) · a4f1ee35

Vincent authored Mar 05, 2025

Signed-off-by: vincent-4 <vincentzhongy+githubvincent4@gmail.com>
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

a4f1ee35

03 Mar, 2025 1 commit
- Update deprecated Python 3.8 typing (#13971) · cf069aa8
  Harry Mellor authored Mar 03, 2025
  
  cf069aa8
24 Feb, 2025 1 commit
- Fix some issues with benchmark data output (#13641) · e7ef74e2
  Huy Do authored Feb 23, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  e7ef74e2
23 Feb, 2025 1 commit
- [Misc] Deprecate `--dataset` from `benchmark_serving.py` (#13708) · 9bebc951
  Roger Wang authored Feb 23, 2025
```
Signed-off-by: Roger Wang <ywang@roblox.com>
```
  9bebc951
17 Feb, 2025 1 commit
- Run v1 benchmark and integrate with PyTorch OSS benchmark database (#13068) · 45186834
  Huy Do authored Feb 17, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  45186834
12 Feb, 2025 1 commit
- [RFC][vllm-API] Support tokenizer registry for customized tokenizer in vLLM (#12518) · 3ee696a6
  Keyun Tong authored Feb 11, 2025
```
Signed-off-by: Keyun Tong <tongkeyun@gmail.com>
```
  3ee696a6
11 Feb, 2025 1 commit

[Benchmark] Add BurstGPT to benchmark_serving (#13063) · 58047c6f

Woosuk Kwon authored Feb 10, 2025


Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

58047c6f