Commits · c9d838fc338db9a5a23cb3906d17c47423c4c9e4 · OpenDAS / vllm_cscc

18 Mar, 2026 1 commit

Adding deterministic lora benchmarking to vLLM Bench (#36057) · c9d838fc

RonaldBXu authored Mar 18, 2026


Signed-off-by: Ubuntu <ubuntu@ip-172-31-43-201.ap-northeast-1.compute.internal>
Signed-off-by: Ronald Xu <ronaldxu@amazon.com>

c9d838fc

17 Mar, 2026 2 commits
- [Models] Cohere ASR (#35809) · b5ca9c35
  Ekagra Ranjan authored Mar 17, 2026
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  b5ca9c35
- [Chore] Replace all base64 usages with faster pybase64 package (#37290) · a836524d
  Isotr0py authored Mar 17, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a836524d
09 Mar, 2026 1 commit
- [Bug] Fix pooling model benchmark script (#36300) · be292b7c
  Wentao Ye authored Mar 09, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  be292b7c
07 Mar, 2026 1 commit
- refine `vllm bench throughput --backend hf` (#35971) · 7eb524e6
  Kunshang Ji authored Mar 07, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  7eb524e6
05 Mar, 2026 1 commit
- [Bugfix] Fix Qwen-VL tokenizer implementation (#36140) · 71963481
  Cyrus Leung authored Mar 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  71963481
28 Feb, 2026 5 commits
- [Benchmark] Avoid unnecessary video download in MMVU (#35618) · 1dafb29f
  Cyrus Leung authored Mar 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1dafb29f
- custom dataset img support base64 (#35280) · c68e69f1
  flutist authored Feb 28, 2026
```
Signed-off-by: xjx <493337577@qq.com>
```
  c68e69f1
- [Benchmark] Improve UX of sweep scripts (#35600) · 4292e3b8
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4292e3b8
- [Benchmark] Rename SLA Finder to Workload Explorer (#35586) · 24d6ea8a
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  24d6ea8a
- [Bugfix] Fixes for SLA finder (#35537) · fd68cd13
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fd68cd13
26 Feb, 2026 2 commits
- [Benchmarks] Plot benchmark timeline and requests statistics (#35220) · 02acd168
  Sophie du Couédic authored Feb 26, 2026
```
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  02acd168
- [Benchmark] Simplify SLA scan (#35306) · d3a51da9
  Cyrus Leung authored Feb 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d3a51da9
23 Feb, 2026 2 commits
- [Refactor] Decouple TimingContext from InputProcessingContext (#35083) · 39264545
  Cyrus Leung authored Feb 23, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39264545
- [Bugfix] Fix kernel benchmark (#33752) · 7291d1b2
  Jee Jee Li authored Feb 23, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7291d1b2
22 Feb, 2026 1 commit
- [Benchmark] Use `sns.relplot` for plotting (#35027) · cbd95a2d
  Cyrus Leung authored Feb 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbd95a2d
21 Feb, 2026 1 commit
- [Benchmark] Improve benchmarks (#35012) · f74f1572
  Cyrus Leung authored Feb 21, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f74f1572
14 Feb, 2026 1 commit

[Renderer] Move InputPreprocessor into Renderer (1/2) (#34510) · 73391a1b

Cyrus Leung authored Feb 15, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

73391a1b

13 Feb, 2026 1 commit
- [Bugfix] Fix Random Dataset Prefix Length Inaccuracy (#33907) · b86bf441
  Frank Wang authored Feb 12, 2026
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  b86bf441
11 Feb, 2026 2 commits
- [Benchmarks] Reduce ready checker log verbosity (#34349) · 144d9b7c
  Tomas Ruiz authored Feb 11, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  144d9b7c
- [Redo] Add `--trust-remote-code` to dataset bench args (#34251) · 3bcd494e
  Cyrus Leung authored Feb 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3bcd494e
10 Feb, 2026 6 commits
- Support benchmarking of Geospatial models (#33922) · 599e4335
  mgazz authored Feb 10, 2026
```
Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
```
  599e4335
- add --insecure arg to the vllm bench to skip TLS (#34026) · a1946570
  Fan Yang authored Feb 10, 2026
```
Signed-off-by: Fan Yang <yan9fan@meta.com>
Co-authored-by: Fan Yang <yan9fan@meta.com>
```
  a1946570
- [Bugfix] Fix `--trust-remote-code` conflict (#34218) · 2c32558a
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2c32558a
- Revert #34208 (#34216) · 998e2d91
  Cyrus Leung authored Feb 10, 2026
  
  998e2d91
- [responsesAPI] fix simpleContext streaming output_messages (#34188) · 9608844f
  Andrew Xia authored Feb 09, 2026
```
Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  9608844f
- [Bugfix] Add `--trust-remote-code` to dataset bench args (#34208) · f69b903b
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f69b903b
09 Feb, 2026 1 commit

[ASR] Fix audio benchmark and add RTFx metric (#32300) · 1d5922fa

Ekagra Ranjan authored Feb 09, 2026


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

1d5922fa

04 Feb, 2026 1 commit
- Save startup benchmark results as a list of values (#33629) · 26471636
  Huy Do authored Feb 03, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  26471636
02 Feb, 2026 1 commit

[Misc] support arbitrary MM datasets in spec dec bench (#33486) · ba871fb7

Komal Kumar Teru authored Feb 02, 2026


Signed-off-by: kkt-cohere <komal@cohere.com>
Signed-off-by: Komal Kumar Teru <162363718+kkt-cohere@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

ba871fb7

01 Feb, 2026 3 commits
- Change defaults for vllm bench startup (#33489) · 67202387
  Luka Govedič authored Feb 01, 2026
  
  67202387
- fix: only include Authorization header when OPENAI_API_KEY is set (#33488) · 754a8ca9
  Zack Yu authored Jan 31, 2026
```
Signed-off-by: zack041 <zackyu041@gmail.com>
```
  754a8ca9
- [Bugfix] Fix inconsistent handling of cache reset (#33481) · 79b6ec6a
  Cyrus Leung authored Feb 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  79b6ec6a
30 Jan, 2026 1 commit
- Indicate compile mode in the benchmark results (#32990) · 9ca66ecc
  Huy Do authored Jan 30, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  9ca66ecc
28 Jan, 2026 1 commit
- Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
  Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2eb673a0
24 Jan, 2026 2 commits

[Bugfix] Fix E2E latency calculation and add warmup support in mm_processor benchmark (#32646) · 6450b536

Hiroken. authored Jan 24, 2026

Signed-off-by: Hongjian Zhang <zhanghongjian@xiaohongshu.com>
Signed-off-by: Xingran Wang <wangxingran123456@outlook.com>
Signed-off-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>
Co-authored-by: Xingran Wang <wangxingran123456@outlook.com>

6450b536

feat(benchmark): add encoder forward pass benchmarking to mm-processor (#31655) · 06b557ec

Reagan Lee authored Jan 24, 2026

Signed-off-by: Reagan <reaganjlee@gmail.com>
Signed-off-by: Reagan Lee <96998476+reaganjlee@users.noreply.github.com>
Co-authored-by: Hiroken. <105287758+HirokenOvo@users.noreply.github.com>

06b557ec

23 Jan, 2026 1 commit
- [Benchmark][Bugfix] Fix race condtion when starting server for sweep benchmark (#32927) · 243e78c2
  Isotr0py authored Jan 23, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  243e78c2
22 Jan, 2026 2 commits
- [Benchmark] Don't default to `temperature==0` in `vllm bench serve` (#32723) · 098b2d66
  Nick Hill authored Jan 22, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  098b2d66
- [bench] add start_times field to vllm bench serve json result (#32667) · 1bf1a34b
  Kebe authored Jan 22, 2026
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  1bf1a34b