Commits · 1d5922fadeebc5ec133dc1c88eb1e85605a5510c · OpenDAS / vllm_cscc

09 Feb, 2026 1 commit

[ASR] Fix audio benchmark and add RTFx metric (#32300) · 1d5922fa

Ekagra Ranjan authored Feb 09, 2026


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

1d5922fa

04 Feb, 2026 1 commit
- Save startup benchmark results as a list of values (#33629) · 26471636
  Huy Do authored Feb 03, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  26471636
02 Feb, 2026 1 commit

[Misc] support arbitrary MM datasets in spec dec bench (#33486) · ba871fb7

Komal Kumar Teru authored Feb 02, 2026


Signed-off-by: kkt-cohere <komal@cohere.com>
Signed-off-by: Komal Kumar Teru <162363718+kkt-cohere@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

ba871fb7

01 Feb, 2026 3 commits
- Change defaults for vllm bench startup (#33489) · 67202387
  Luka Govedič authored Feb 01, 2026
  
  67202387
- fix: only include Authorization header when OPENAI_API_KEY is set (#33488) · 754a8ca9
  Zack Yu authored Jan 31, 2026
```
Signed-off-by: zack041 <zackyu041@gmail.com>
```
  754a8ca9
- [Bugfix] Fix inconsistent handling of cache reset (#33481) · 79b6ec6a
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  79b6ec6a
30 Jan, 2026 1 commit
- Indicate compile mode in the benchmark results (#32990) · 9ca66ecc
  Huy Do authored Jan 30, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  9ca66ecc
28 Jan, 2026 1 commit
- Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
  Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2eb673a0
24 Jan, 2026 2 commits

[Bugfix] Fix E2E latency calculation and add warmup support in mm_processor benchmark (#32646) · 6450b536

Hiroken. authored Jan 24, 2026

Signed-off-by: Hongjian Zhang <zhanghongjian@xiaohongshu.com>
Signed-off-by: Xingran Wang <wangxingran123456@outlook.com>
Signed-off-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>
Co-authored-by: Xingran Wang <wangxingran123456@outlook.com>

6450b536

feat(benchmark): add encoder forward pass benchmarking to mm-processor (#31655) · 06b557ec

Reagan Lee authored Jan 24, 2026

Signed-off-by: Reagan <reaganjlee@gmail.com>
Signed-off-by: Reagan Lee <96998476+reaganjlee@users.noreply.github.com>
Co-authored-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>

06b557ec

23 Jan, 2026 1 commit
- [Benchmark][Bugfix] Fix race condtion when starting server for sweep benchmark (#32927) · 243e78c2
  Isotr0py authored Jan 23, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  243e78c2
22 Jan, 2026 2 commits
- [Benchmark] Don't default to `temperature==0` in `vllm bench serve` (#32723) · 098b2d66
  Nick Hill authored Jan 22, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  098b2d66
- [bench] add start_times field to vllm bench serve json result (#32667) · 1bf1a34b
  Kebe authored Jan 22, 2026
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  1bf1a34b
19 Jan, 2026 1 commit
- feat: spec decode with draft models (#24322) · 4a5299c9
  Tomas Ruiz authored Jan 19, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  4a5299c9
15 Jan, 2026 1 commit
- [Benchmark] [Feature] add vllm bench sweep startup command (#32337) · 3a4e10c8
  rongfu.leng authored Jan 15, 2026
```
Signed-off-by: lengrongfu <lenronfu@gmail.com>
```
  3a4e10c8
14 Jan, 2026 1 commit
- [1/N] Reorganize multimodal processing code (#32327) · 9ea07b41
  Cyrus Leung authored Jan 14, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9ea07b41
12 Jan, 2026 2 commits
- [Benchmark] Share data between SLA runs (#32184) · 7c0d3c51
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7c0d3c51
- [Misc] Disable default `--ready-check-timeout-sec` extra call in vllm bench (#30975) · 22970c16
  Nicolò Lucchesi authored Jan 12, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  22970c16
11 Jan, 2026 1 commit
- [Benchmark][2/2] Use spline interpolation to tune SLA variables (#32095) · ef96fa3f
  Cyrus Leung authored Jan 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ef96fa3f
10 Jan, 2026 2 commits
- [Benchmark][1/2] Generalize SLA criterion validation from binary flags to margins (#32075) · 5f2385a4
  Cyrus Leung authored Jan 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5f2385a4
- resolve pydantic error in startup benchmark (#31348) · abd92242
  Ning Xie authored Jan 10, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  abd92242
09 Jan, 2026 1 commit
- [Feature][Benchmarks] Custom dataset: read output length from dataset (#31881) · b474782a
  Sophie du Couédic authored Jan 09, 2026
```
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
```
  b474782a
07 Jan, 2026 1 commit
- [Frontend] Implement robust video frame recovery for corrupted videos (#29197) · 6f351548
  vSeamar authored Jan 06, 2026
```
Signed-off-by: cmartinez <cmartinez@roblox.com>
Signed-off-by: vSeamar <cmartinez@roblox.com>
```
  6f351548
06 Jan, 2026 2 commits
- [Spec Decode][UX] Add acceptance stats to `vllm bench serve` report (#31739) · d4989973
  Matthew Bonanni authored Jan 06, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
```
  d4989973
- Report error log after vllm bench serve (#31808) · dba95378
  Elvir Crnčević authored Jan 06, 2026
```
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
```
  dba95378
02 Jan, 2026 1 commit

Add Multimodal Processor Benchmark (#29105) · 1f5b7c41

Reagan Lee authored Jan 01, 2026


Signed-off-by: Reagan Lee <reaganjlee@gmail.com>
Signed-off-by: Reagan <reaganjlee@gmail.com>

1f5b7c41

26 Dec, 2025 1 commit
- [benchmark] use model card root instead of id (#31329) · 3b8f31b3
  Ning Xie authored Dec 26, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  3b8f31b3
24 Dec, 2025 1 commit
- Revert "[bench] Support common prefix len config (for decode-only bench)" (#31240) · 3bb95619
  Ming Yang authored Dec 23, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3bb95619
18 Dec, 2025 1 commit
- [Misc] support nsys profile for bench latency (#29776) · eee600c3
  zhrrr authored Dec 18, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  eee600c3
17 Dec, 2025 1 commit
- [UX] Make `vllm bench serve` discover model by default and use --input-len (#30816) · 519ef9a9
  Michael Goin authored Dec 17, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  519ef9a9
16 Dec, 2025 1 commit

[Bugfix] Fix prefix_repetition routing in bench throughput (#29663) · 676db55e

Junru Shen authored Dec 16, 2025


Signed-off-by: Junru Shen <jrshen.sjr@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

676db55e

14 Dec, 2025 2 commits
- [Bugfix][benchmarks] Fix input token calculation for rerank benchmark metrics (#30596) · add4b0ca
  Vensen authored Dec 14, 2025
```
Signed-off-by: vensen <vensenmu@gmail.com>
```
  add4b0ca
- [Misc] Add a script to benchmark compilation time (#29919) · a8ec4865
  Bin Bao authored Dec 14, 2025
```
Signed-off-by: Bin Bao <binbao@meta.com>
```
  a8ec4865
10 Dec, 2025 1 commit
- [Misc] Consistent case for `vllm bench serve` results (#30403) · 794a7875
  Matthew Bonanni authored Dec 10, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  794a7875
09 Dec, 2025 1 commit

[Cleanup] Refactor profiling env vars into a CLI config (#29912) · e858bfe0

Benjamin Chislett authored Dec 09, 2025

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e858bfe0

06 Dec, 2025 1 commit
- [Bugfix]: Fix `TokenizerLike` interface (#30009) · 40a046cd
  Rohan Potdar authored Dec 05, 2025
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  40a046cd
05 Dec, 2025 1 commit
- [bench] Support common prefix len config (for decode-only bench) (#29934) · f16356fe
  Ming Yang authored Dec 05, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  f16356fe
02 Dec, 2025 2 commits

Fix boolean nested params, add dict format support, and enhance plotting for... · 1c593e11

Copilot authored Dec 02, 2025

Fix boolean nested params, add dict format support, and enhance plotting for vllm bench sweep (#29025)
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

1c593e11

[Chore] Move tokenizer initialization methods (#29793) · 653591d5
Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
653591d5

29 Nov, 2025 1 commit
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427