Commits · 1f5b7c41c3e3ed97152d0ae28091141280fff20f · OpenDAS / vllm_cscc

02 Jan, 2026 1 commit

Add Multimodal Processor Benchmark (#29105) · 1f5b7c41

Reagan Lee authored Jan 01, 2026


Signed-off-by: Reagan Lee <reaganjlee@gmail.com>
Signed-off-by: Reagan <reaganjlee@gmail.com>

1f5b7c41

26 Dec, 2025 1 commit
- [benchmark] use model card root instead of id (#31329) · 3b8f31b3
  Ning Xie authored Dec 26, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  3b8f31b3
24 Dec, 2025 1 commit
- Revert "[bench] Support common prefix len config (for decode-only bench)" (#31240) · 3bb95619
  Ming Yang authored Dec 23, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3bb95619
18 Dec, 2025 1 commit
- [Misc] support nsys profile for bench latency (#29776) · eee600c3
  zhrrr authored Dec 18, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  eee600c3
17 Dec, 2025 1 commit
- [UX] Make `vllm bench serve` discover model by default and use --input-len (#30816) · 519ef9a9
  Michael Goin authored Dec 17, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  519ef9a9
16 Dec, 2025 1 commit

[Bugfix] Fix prefix_repetition routing in bench throughput (#29663) · 676db55e

Junru Shen authored Dec 16, 2025


Signed-off-by: Junru Shen <jrshen.sjr@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

676db55e

14 Dec, 2025 2 commits
- [Bugfix][benchmarks] Fix input token calculation for rerank benchmark metrics (#30596) · add4b0ca
  Vensen authored Dec 14, 2025
```
Signed-off-by: vensen <vensenmu@gmail.com>
```
  add4b0ca
- [Misc] Add a script to benchmark compilation time (#29919) · a8ec4865
  Bin Bao authored Dec 14, 2025
```
Signed-off-by: Bin Bao <binbao@meta.com>
```
  a8ec4865
10 Dec, 2025 1 commit
- [Misc] Consistent case for `vllm bench serve` results (#30403) · 794a7875
  Matthew Bonanni authored Dec 10, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  794a7875
09 Dec, 2025 1 commit

[Cleanup] Refactor profiling env vars into a CLI config (#29912) · e858bfe0

Benjamin Chislett authored Dec 09, 2025

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e858bfe0

06 Dec, 2025 1 commit
- [Bugfix]: Fix `TokenizerLike` interface (#30009) · 40a046cd
  Rohan Potdar authored Dec 05, 2025
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  40a046cd
05 Dec, 2025 1 commit
- [bench] Support common prefix len config (for decode-only bench) (#29934) · f16356fe
  Ming Yang authored Dec 05, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  f16356fe
02 Dec, 2025 2 commits

Fix boolean nested params, add dict format support, and enhance plotting for... · 1c593e11

Copilot authored Dec 02, 2025

Fix boolean nested params, add dict format support, and enhance plotting for vllm bench sweep (#29025)
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

1c593e11

[Chore] Move tokenizer initialization methods (#29793) · 653591d5
Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
653591d5

29 Nov, 2025 1 commit
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
28 Nov, 2025 1 commit
- [Feature][Bench] Add pareto visualization (#29477) · 48059895
  rongfu.leng authored Nov 28, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  48059895
27 Nov, 2025 1 commit
- [Doc]: fixing typos in diverse files (#29492) · 66d3d542
  Didier Durand authored Nov 27, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  66d3d542
24 Nov, 2025 1 commit
- [Feature][Benchmark] add --link-vars can filter when serve_param equal bench_param (#28909) · 68dfe28e
  rongfu.leng authored Nov 24, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  68dfe28e
16 Nov, 2025 1 commit
- [Bugfix] Fix host and port join for ipv6 in bench serve (#28679) · 3bc11757
  scottzh8 authored Nov 16, 2025
```
Signed-off-by: Scott Zhang <scottzh@fb.com>
Co-authored-by: Scott Zhang <scottzh@fb.com>
```
  3bc11757
10 Nov, 2025 1 commit
- [Perf] Move gc.freeze logic from EngineCoreProc to EngineCore for better coverage (#27896) · b30372cb
  Jialin Ouyang authored Nov 10, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  b30372cb
07 Nov, 2025 2 commits
- [Feature] Default `ignore_eos` True for `random` dataset (#28227) · 4b1ff132
  Wentao Ye authored Nov 07, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  4b1ff132
- [FixBug]Aeala/ShareGPT_Vicuna_unfiltered marked as multimodal benchmark (#28265) · 315068eb
  汪志鹏 authored Nov 07, 2025
```
Signed-off-by: princepride <wangzhipeng628@gmail.com>
```
  315068eb
06 Nov, 2025 1 commit
- Make the cv2 dependency optional (#27780) · d72299d4
  Jacob Zhong authored Nov 06, 2025
```
Signed-off-by: Jacob <cmpute@qq.com>
```
  d72299d4
03 Nov, 2025 1 commit
- [Feature][Benchmarks] Support `inf` burstiness (#26941) · a4398fbb
  Sophie du Couédic authored Nov 03, 2025
```
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
```
  a4398fbb
31 Oct, 2025 1 commit
- [benchmark] Make request IDs unique across clients by default (#27723) · b2e65cb4
  Seiji Eicher authored Oct 30, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  b2e65cb4
29 Oct, 2025 2 commits

[Frontend] Add `vllm bench sweep` to CLI (#27639) · ecca3fee

Cyrus Leung authored Oct 29, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

ecca3fee

Feature/video support in random mm dataset (#25963) · 5e72216d

Eugene Khvedchenya authored Oct 29, 2025


Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Eugene Khvedchenya <ekhvedchenia@nvidia.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

5e72216d

26 Oct, 2025 2 commits
- [Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6
  Yeshwanth N authored Oct 26, 2025
```
Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>
```
  71b1c8b6
- [bugfix]fix empty prompts for async-engine mode in benchmark throughput (#27494) · 315b860a
  Lucia Fang authored Oct 26, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
```
  315b860a
24 Oct, 2025 1 commit
- [Benchmark] Enable benchmark to run with `encoding_format="bytes"` (#27467) · b7030d96
  Cyrus Leung authored Oct 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b7030d96
23 Oct, 2025 1 commit
- [Bugfix] Fix SLA tuner initialization (#27355) · 6738e4a0
  Cyrus Leung authored Oct 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6738e4a0
22 Oct, 2025 1 commit
- [Benchmark] Add plot utility for parameter sweep (#27168) · ceacedc1
  Cyrus Leung authored Oct 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ceacedc1
19 Oct, 2025 2 commits
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
- [Benchmark] Convenience script for multiple parameter combinations (#27085) · b3aba04e
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b3aba04e
17 Oct, 2025 3 commits
- [Docs] Replace `rst` style double-backtick with `md` single-backtick (#27091) · 6c9fdbf7
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c9fdbf7
- vllm bench serve shows num of failed requests (#26478) · 965c5f49
  Tomas Ruiz authored Oct 17, 2025
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  965c5f49
- [Chore] Separate out `vllm.utils.importlib` (#27022) · 4d4d6bad
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4d4d6bad
16 Oct, 2025 3 commits
- [Bug] Add Assertion for `random-input-len` / `random-output-len` (#26834) · 23583ee2
  Wentao Ye authored Oct 16, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  23583ee2
- Adding Warmup to Benchmark Serving (#26943) · 013abde6
  kimbochen authored Oct 16, 2025
```
Signed-off-by: Kimbo Chen <chentenghung@gmail.com>
```
  013abde6
- [Benchmark] Show E2EL by default for pooling models (#27014) · 334535b6
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  334535b6