Commits · 4c47710bf707e93bdf83391948f844e461b7ba4f · OpenDAS / vllm_cscc · GitLab

16 Apr, 2026 1 commit
- [Bugfix] Fix bench_serve UTF-8 decode crash on split multi-byte chars (#38732) · de111f32
  Yufeng He authored Apr 17, 2026
  
  de111f32
15 Apr, 2026 1 commit
- [SpecDecode][Benchmark] Add SPEED-bench support to benchmarking CLI (#36029) · 3cc328a4
  Talor Abramovich authored Apr 15, 2026
```
Signed-off-by: talora <talora@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
```
  3cc328a4
14 Apr, 2026 3 commits
- Measure encoder compile time seperate from llm backbone (#39240) · c08f3b2a
  Lucas Kabela authored Apr 14, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  c08f3b2a
- [Bugfix] Fix `vllm bench serve` to count multimodal tokens in "total input tokens" (#38654) · 1e4748c6
  Matthias Gehre authored Apr 14, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  1e4748c6
- feat: add TxtSlicesDataset to allow sampling slices from txt file for benchmarking (#30156) · 893b2aff
  Julien Debache authored Apr 14, 2026
```
Signed-off-by: jdebache <jdebache@nvidia.com>
```
  893b2aff
08 Apr, 2026 1 commit
- [Bugfix] Add missing ASRDataset import and CLI args in benchmarks/throughput.py (#38114) · 1a2c1763
  nemanjaudovic authored Apr 08, 2026
```
Signed-off-by: nemanjaudovic <nudovic@amd.com>
```
  1a2c1763
25 Mar, 2026 2 commits
- [Misc] Reorganize inputs (#35182) · ba2f0acc
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ba2f0acc
- [Mypy] Better fixes for the `mypy` issues in `vllm/config` (#37902) · d215d1ef
  Harry Mellor authored Mar 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d215d1ef
21 Mar, 2026 1 commit
- [Frontend] Remove librosa from audio dependency (#37058) · c7f98b4d
  Isotr0py authored Mar 21, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c7f98b4d
20 Mar, 2026 1 commit
- [V0 Deprecation] Deprecate --disable-frontend-multiprocessing (#37612) · 9040151f
  Flora Feng authored Mar 19, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  9040151f
19 Mar, 2026 1 commit
- Stop bench CLI from recursively casting all configs to `dict` (#37559) · 572b4329
  Harry Mellor authored Mar 19, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  572b4329
18 Mar, 2026 1 commit

Adding deterministic lora benchmarking to vLLM Bench (#36057) · c9d838fc

RonaldBXu authored Mar 18, 2026


Signed-off-by: Ubuntu <ubuntu@ip-172-31-43-201.ap-northeast-1.compute.internal>
Signed-off-by: Ronald Xu <ronaldxu@amazon.com>

c9d838fc

17 Mar, 2026 2 commits
- [Models] Cohere ASR (#35809) · b5ca9c35
  Ekagra Ranjan authored Mar 17, 2026
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  b5ca9c35
- [Chore] Replace all base64 usages with faster pybase64 package (#37290) · a836524d
  Isotr0py authored Mar 17, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a836524d
09 Mar, 2026 1 commit
- [Bug] Fix pooling model benchmark script (#36300) · be292b7c
  Wentao Ye authored Mar 09, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  be292b7c
07 Mar, 2026 1 commit
- refine `vllm bench throughput --backend hf` (#35971) · 7eb524e6
  Kunshang Ji authored Mar 07, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  7eb524e6
05 Mar, 2026 1 commit
- [Bugfix] Fix Qwen-VL tokenizer implementation (#36140) · 71963481
  Cyrus Leung authored Mar 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  71963481
28 Feb, 2026 5 commits
- [Benchmark] Avoid unnecessary video download in MMVU (#35618) · 1dafb29f
  Cyrus Leung authored Mar 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1dafb29f
- custom dataset img support base64 (#35280) · c68e69f1
  flutist authored Feb 28, 2026
```
Signed-off-by: xjx <493337577@qq.com>
```
  c68e69f1
- [Benchmark] Improve UX of sweep scripts (#35600) · 4292e3b8
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4292e3b8
- [Benchmark] Rename SLA Finder to Workload Explorer (#35586) · 24d6ea8a
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  24d6ea8a
- [Bugfix] Fixes for SLA finder (#35537) · fd68cd13
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fd68cd13
26 Feb, 2026 2 commits
- [Benchmarks] Plot benchmark timeline and requests statistics (#35220) · 02acd168
  Sophie du Couédic authored Feb 26, 2026
```
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  02acd168
- [Benchmark] Simplify SLA scan (#35306) · d3a51da9
  Cyrus Leung authored Feb 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d3a51da9
23 Feb, 2026 2 commits
- [Refactor] Decouple TimingContext from InputProcessingContext (#35083) · 39264545
  Cyrus Leung authored Feb 23, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  39264545
- [Bugfix] Fix kernel benchmark (#33752) · 7291d1b2
  Jee Jee Li authored Feb 23, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7291d1b2
22 Feb, 2026 1 commit
- [Benchmark] Use `sns.relplot` for plotting (#35027) · cbd95a2d
  Cyrus Leung authored Feb 22, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  cbd95a2d
21 Feb, 2026 1 commit
- [Benchmark] Improve benchmarks (#35012) · f74f1572
  Cyrus Leung authored Feb 21, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f74f1572
14 Feb, 2026 1 commit

[Renderer] Move InputPreprocessor into Renderer (1/2) (#34510) · 73391a1b

Cyrus Leung authored Feb 15, 2026


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

73391a1b

13 Feb, 2026 1 commit
- [Bugfix] Fix Random Dataset Prefix Length Inaccuracy (#33907) · b86bf441
  Frank Wang authored Feb 12, 2026
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  b86bf441
11 Feb, 2026 2 commits
- [Benchmarks] Reduce ready checker log verbosity (#34349) · 144d9b7c
  Tomas Ruiz authored Feb 11, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  144d9b7c
- [Redo] Add `--trust-remote-code` to dataset bench args (#34251) · 3bcd494e
  Cyrus Leung authored Feb 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3bcd494e
10 Feb, 2026 6 commits
- Support benchmarking of Geospatial models (#33922) · 599e4335
  mgazz authored Feb 10, 2026
```
Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
```
  599e4335
- add --insecure arg to the vllm bench to skip TLS (#34026) · a1946570
  Fan Yang authored Feb 10, 2026
```
Signed-off-by: Fan Yang <yan9fan@meta.com>
Co-authored-by: Fan Yang <yan9fan@meta.com>
```
  a1946570
- [Bugfix] Fix `--trust-remote-code` conflict (#34218) · 2c32558a
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2c32558a
- Revert #34208 (#34216) · 998e2d91
  Cyrus Leung authored Feb 10, 2026
  
  998e2d91
- [responsesAPI] fix simpleContext streaming output_messages (#34188) · 9608844f
  Andrew Xia authored Feb 09, 2026
```
Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  9608844f
- [Bugfix] Add `--trust-remote-code` to dataset bench args (#34208) · f69b903b
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f69b903b
09 Feb, 2026 1 commit

[ASR] Fix audio benchmark and add RTFx metric (#32300) · 1d5922fa

Ekagra Ranjan authored Feb 09, 2026


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

1d5922fa

04 Feb, 2026 1 commit
- Save startup benchmark results as a list of values (#33629) · 26471636
  Huy Do authored Feb 03, 2026
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  26471636