Commits · f74f1572ca3a0973d8db2187f0064bfecb6d5df2 · OpenDAS / vllm_cscc

21 Feb, 2026 1 commit
- [Benchmark] Improve benchmarks (#35012) · f74f1572
  Cyrus Leung authored Feb 21, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f74f1572
14 Feb, 2026 1 commit

[Renderer] Move InputPreprocessor into Renderer (1/2) (#34510) · 73391a1b

Cyrus Leung authored Feb 15, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

73391a1b

13 Feb, 2026 1 commit
- [Bugfix] Fix Random Dataset Prefix Length Inaccuracy (#33907) · b86bf441
  Frank Wang authored Feb 12, 2026
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  b86bf441
11 Feb, 2026 2 commits
- [Benchmarks] Reduce ready checker log verbosity (#34349) · 144d9b7c
  Tomas Ruiz authored Feb 11, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  144d9b7c
- [Redo] Add `--trust-remote-code` to dataset bench args (#34251) · 3bcd494e
  Cyrus Leung authored Feb 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3bcd494e
10 Feb, 2026 6 commits
- Support benchmarking of Geospatial models (#33922) · 599e4335
  mgazz authored Feb 10, 2026
```
Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
```
  599e4335
- add --insecure arg to the vllm bench to skip TLS (#34026) · a1946570
  Fan Yang authored Feb 10, 2026
```
Signed-off-by: Fan Yang <yan9fan@meta.com>
Co-authored-by: Fan Yang <yan9fan@meta.com>
```
  a1946570
- [Bugfix] Fix `--trust-remote-code` conflict (#34218) · 2c32558a
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2c32558a
- Revert #34208 (#34216) · 998e2d91
  Cyrus Leung authored Feb 10, 2026
  
  998e2d91
- [responsesAPI] fix simpleContext streaming output_messages (#34188) · 9608844f
  Andrew Xia authored Feb 09, 2026
```
Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  9608844f
- [Bugfix] Add `--trust-remote-code` to dataset bench args (#34208) · f69b903b
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f69b903b
09 Feb, 2026 1 commit

[ASR] Fix audio benchmark and add RTFx metric (#32300) · 1d5922fa

Ekagra Ranjan authored Feb 09, 2026


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

1d5922fa

04 Feb, 2026 1 commit
- Save startup benchmark results as a list of values (#33629) · 26471636
  Huy Do authored Feb 03, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  26471636
02 Feb, 2026 1 commit

[Misc] support arbitrary MM datasets in spec dec bench (#33486) · ba871fb7

Komal Kumar Teru authored Feb 02, 2026


Signed-off-by: kkt-cohere <komal@cohere.com>
Signed-off-by: Komal Kumar Teru <162363718+kkt-cohere@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

ba871fb7

01 Feb, 2026 3 commits
- Change defaults for vllm bench startup (#33489) · 67202387
  Luka Govedič authored Feb 01, 2026
  
  67202387
- fix: only include Authorization header when OPENAI_API_KEY is set (#33488) · 754a8ca9
  Zack Yu authored Jan 31, 2026
```
Signed-off-by: zack041 <zackyu041@gmail.com>
```
  754a8ca9
- [Bugfix] Fix inconsistent handling of cache reset (#33481) · 79b6ec6a
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  79b6ec6a
30 Jan, 2026 1 commit
- Indicate compile mode in the benchmark results (#32990) · 9ca66ecc
  Huy Do authored Jan 30, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  9ca66ecc
28 Jan, 2026 1 commit
- Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
  Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2eb673a0
24 Jan, 2026 2 commits

[Bugfix] Fix E2E latency calculation and add warmup support in mm_processor benchmark (#32646) · 6450b536

Hiroken. authored Jan 24, 2026

Signed-off-by: Hongjian Zhang <zhanghongjian@xiaohongshu.com>
Signed-off-by: Xingran Wang <wangxingran123456@outlook.com>
Signed-off-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>
Co-authored-by: Xingran Wang <wangxingran123456@outlook.com>

6450b536

feat(benchmark): add encoder forward pass benchmarking to mm-processor (#31655) · 06b557ec

Reagan Lee authored Jan 24, 2026

Signed-off-by: Reagan <reaganjlee@gmail.com>
Signed-off-by: Reagan Lee <96998476+reaganjlee@users.noreply.github.com>
Co-authored-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>

06b557ec

23 Jan, 2026 1 commit
- [Benchmark][Bugfix] Fix race condtion when starting server for sweep benchmark (#32927) · 243e78c2
  Isotr0py authored Jan 23, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  243e78c2
22 Jan, 2026 2 commits
- [Benchmark] Don't default to `temperature==0` in `vllm bench serve` (#32723) · 098b2d66
  Nick Hill authored Jan 22, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  098b2d66
- [bench] add start_times field to vllm bench serve json result (#32667) · 1bf1a34b
  Kebe authored Jan 22, 2026
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  1bf1a34b
19 Jan, 2026 1 commit
- feat: spec decode with draft models (#24322) · 4a5299c9
  Tomas Ruiz authored Jan 19, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  4a5299c9
15 Jan, 2026 1 commit
- [Benchmark] [Feature] add vllm bench sweep startup command (#32337) · 3a4e10c8
  rongfu.leng authored Jan 15, 2026
```
Signed-off-by: lengrongfu <lenronfu@gmail.com>
```
  3a4e10c8
14 Jan, 2026 1 commit
- [1/N] Reorganize multimodal processing code (#32327) · 9ea07b41
  Cyrus Leung authored Jan 14, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9ea07b41
12 Jan, 2026 2 commits
- [Benchmark] Share data between SLA runs (#32184) · 7c0d3c51
  Cyrus Leung authored Jan 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7c0d3c51
- [Misc] Disable default `--ready-check-timeout-sec` extra call in vllm bench (#30975) · 22970c16
  Nicolò Lucchesi authored Jan 12, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  22970c16
11 Jan, 2026 1 commit
- [Benchmark][2/2] Use spline interpolation to tune SLA variables (#32095) · ef96fa3f
  Cyrus Leung authored Jan 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ef96fa3f
10 Jan, 2026 2 commits
- [Benchmark][1/2] Generalize SLA criterion validation from binary flags to margins (#32075) · 5f2385a4
  Cyrus Leung authored Jan 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5f2385a4
- resolve pydantic error in startup benchmark (#31348) · abd92242
  Ning Xie authored Jan 10, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  abd92242
09 Jan, 2026 1 commit
- [Feature][Benchmarks] Custom dataset: read output length from dataset (#31881) · b474782a
  Sophie du Couédic authored Jan 09, 2026
```
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
```
  b474782a
07 Jan, 2026 1 commit
- [Frontend] Implement robust video frame recovery for corrupted videos (#29197) · 6f351548
  vSeamar authored Jan 06, 2026
```
Signed-off-by: cmartinez <cmartinez@roblox.com>
Signed-off-by: vSeamar <cmartinez@roblox.com>
```
  6f351548
06 Jan, 2026 2 commits
- [Spec Decode][UX] Add acceptance stats to `vllm bench serve` report (#31739) · d4989973
  Matthew Bonanni authored Jan 06, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
```
  d4989973
- Report error log after vllm bench serve (#31808) · dba95378
  Elvir Crnčević authored Jan 06, 2026
```
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
```
  dba95378
02 Jan, 2026 1 commit

Add Multimodal Processor Benchmark (#29105) · 1f5b7c41

Reagan Lee authored Jan 01, 2026


Signed-off-by: Reagan Lee <reaganjlee@gmail.com>
Signed-off-by: Reagan <reaganjlee@gmail.com>

1f5b7c41

26 Dec, 2025 1 commit
- [benchmark] use model card root instead of id (#31329) · 3b8f31b3
  Ning Xie authored Dec 26, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  3b8f31b3
24 Dec, 2025 1 commit
- Revert "[bench] Support common prefix len config (for decode-only bench)" (#31240) · 3bb95619
  Ming Yang authored Dec 23, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3bb95619
18 Dec, 2025 1 commit
- [Misc] support nsys profile for bench latency (#29776) · eee600c3
  zhrrr authored Dec 18, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  eee600c3