Commits · c9d838fc338db9a5a23cb3906d17c47423c4c9e4 · OpenDAS / vllm_cscc

18 Mar, 2026 1 commit

Adding deterministic lora benchmarking to vLLM Bench (#36057) · c9d838fc

RonaldBXu authored Mar 18, 2026


Signed-off-by: Ubuntu <ubuntu@ip-172-31-43-201.ap-northeast-1.compute.internal>
Signed-off-by: Ronald Xu <ronaldxu@amazon.com>

c9d838fc

07 Mar, 2026 1 commit
- refine `vllm bench throughput --backend hf` (#35971) · 7eb524e6
  Kunshang Ji authored Mar 07, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  7eb524e6
02 Jan, 2026 1 commit

Add Multimodal Processor Benchmark (#29105) · 1f5b7c41

Reagan Lee authored Jan 01, 2026


Signed-off-by: Reagan Lee <reaganjlee@gmail.com>
Signed-off-by: Reagan <reaganjlee@gmail.com>

1f5b7c41

16 Dec, 2025 1 commit

[Bugfix] Fix prefix_repetition routing in bench throughput (#29663) · 676db55e

Junru Shen authored Dec 16, 2025


Signed-off-by: Junru Shen <jrshen.sjr@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

676db55e

09 Dec, 2025 1 commit

[Cleanup] Refactor profiling env vars into a CLI config (#29912) · e858bfe0

Benjamin Chislett authored Dec 09, 2025

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e858bfe0

06 Dec, 2025 1 commit
- [Bugfix]: Fix `TokenizerLike` interface (#30009) · 40a046cd
  Rohan Potdar authored Dec 05, 2025
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  40a046cd
07 Nov, 2025 1 commit
- [FixBug]Aeala/ShareGPT_Vicuna_unfiltered marked as multimodal benchmark (#28265) · 315068eb
  汪志鹏 authored Nov 07, 2025
```
Signed-off-by: princepride <wangzhipeng628@gmail.com>
```
  315068eb
26 Oct, 2025 1 commit
- [bugfix]fix empty prompts for async-engine mode in benchmark throughput (#27494) · 315b860a
  Lucia Fang authored Oct 26, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  315b860a
19 Oct, 2025 1 commit
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
16 Oct, 2025 1 commit
- [Chore] Rename `utils` submodules (#26920) · f6cdc9a0
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f6cdc9a0
15 Oct, 2025 2 commits
- [Chore] Separate out `vllm.utils.async_utils` (#26913) · 828523ad
  Cyrus Leung authored Oct 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  828523ad
- [Misc] rename torch_dtype to dtype (#26695) · 8f4b313c
  wangxiyuan authored Oct 15, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  8f4b313c
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 2 commits
- [Bugfix] Fix SHM cache initialization (#26427) · 4bdf7ac5
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4bdf7ac5
- [Bugfix] Incorrect another MM data format in vllm bench throughput (#26462) · 8bd696fa
  Huy Do authored Oct 08, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  8bd696fa
08 Oct, 2025 1 commit
- [Bugfix] Incorrect MM data format in `vllm bench throughput` (#26395) · 0d4f48fa
  Cyrus Leung authored Oct 08, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  0d4f48fa
06 Oct, 2025 1 commit
- [Misc] Clean up unnecessary E501 ignore (#26274) · 43c146ca
  Roger Wang authored Oct 06, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  43c146ca
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
30 Sep, 2025 1 commit
- [Benchmark] Support benchmark throughput for external launcher DP (#25913) · d3bd1711
  Zhuohan Li authored Sep 29, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  d3bd1711
11 Sep, 2025 1 commit
- Enable --profile in 'vllm bench throughput' (#24575) · ee0bc5e1
  Tomas Ruiz authored Sep 11, 2025
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  ee0bc5e1
20 Aug, 2025 1 commit
- [CI/Build] Also check DP in benchmarks throughput script (#23038) · f7290232
  Zhewen Li authored Aug 19, 2025
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  f7290232
16 Aug, 2025 1 commit
- Add docs for PrefixRepetitionDataset + enable usage with `vllm bench throughput` (#23012) · de9cb617
  Seiji Eicher authored Aug 16, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  de9cb617
11 Aug, 2025 1 commit
- [Docs] Add comprehensive CLI reference for all large `vllm` subcommands (#22601) · bc1d02ac
  Harry Mellor authored Aug 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bc1d02ac
03 Aug, 2025 1 commit
- [Benchmark] Support ready check timeout in `vllm bench serve` (#21696) · 3f36c325
  Ye (Charlotte) Qi authored Aug 03, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  3f36c325
25 Jul, 2025 1 commit
- [Frontend] `run-batch` supports V1 (#21541) · 34ddcf9f
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34ddcf9f
20 Jun, 2025 1 commit
- [Benchmark] Fix `Value of type "SampleRequest" is not indexable` (#18032) · 5aa4a015
  Brayden Zhong authored Jun 20, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  5aa4a015
03 Jun, 2025 2 commits
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- Reduce logs in CLI scripts and plugin loader (#18970) · cc977286
  Michael Goin authored Jun 03, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cc977286
12 May, 2025 1 commit
- [Fix] Benchmark `"EngineClient" has no attribute "model_config"` (#17976) · 891b9d33
  Brayden Zhong authored May 12, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  891b9d33
15 Apr, 2025 1 commit
- Add `vllm bench [latency, throughput]` CLI commands (#16508) · b4fe16c7
  Michael Goin authored Apr 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b4fe16c7
14 Apr, 2025 1 commit
- [Benchmark][Bugfix] Fix SonnetDataset default values in benchmark_throughput.py (#16556) · 63d2705e
  Jennifer Zhao authored Apr 13, 2025
  
  63d2705e
10 Apr, 2025 1 commit
- Fix range_ratio Bug in RandomDataset (#16126) · 268c3250
  WWW authored Apr 11, 2025
```
Signed-off-by: jadewang21 <jadewangcn@outlook.com>
```
  268c3250
09 Apr, 2025 1 commit
- Fix `benchmark_throughput.py --backend=hf` (#16352) · b2ce859b
  Michael Goin authored Apr 09, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b2ce859b
04 Apr, 2025 1 commit

[Benchmark][Doc] Update throughput benchmark and README (#15998) · 95862f7b

Ziji Shi (Steven) authored Apr 04, 2025


Signed-off-by: StevenShi-23 <shi.ziji.sm@gmail.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

95862f7b

31 Mar, 2025 1 commit
- [Benchmark] Update Vision Arena Dataset and HuggingFaceDataset Setup (#15748) · effc5d24
  Jennifer Zhao authored Mar 31, 2025
```
Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
```
  effc5d24
28 Mar, 2025 1 commit
- [Misc]add coding benchmark for speculative decoding (#15303) · e7f720ea
  Chen Xia authored Mar 27, 2025
```
Signed-off-by: CXIAAAAA <cxia0209@gmail.com>
```
  e7f720ea
14 Mar, 2025 1 commit

[Feature] Add visionarena offline support for benchmark_throughput (#14654) · a6e0d096

Jennifer Zhao authored Mar 13, 2025

Signed-off-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Signed-off-by: Jennifer Zhao <ai.jenniferzhao@gmail.com>
Co-authored-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Co-authored-by: Jennifer Zhao <JenZhao@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

a6e0d096

10 Mar, 2025 1 commit

[Feature] Consolidate performance benchmark datasets (#14036) · 1253b157

Jennifer Zhao authored Mar 10, 2025


Signed-off-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Jennifer Zhao <7443418+JenZhao@users.noreply.github.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

1253b157

07 Mar, 2025 2 commits

[Benchmarks] Make detokenization optional in benchmark scripts (#11697) · 58abe354
Jeremy Arnold authored Mar 07, 2025
```
Signed-off-by: Jeremy Arnold <Jeremy.Arnold@amd.com>
```
58abe354

[BUGFIX] Skip tokenization support for throughput benchmark (#12712) · 0ca3b8e0

Aleksandr Malyshev authored Mar 07, 2025


Signed-off-by: root <root@banff-cyxtera-s73-5.ctr.dcgpu>
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: root <root@banff-cyxtera-s73-5.ctr.dcgpu>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>

0ca3b8e0