Commits · 7b1e0b07d0ea9fe11f0c4a35001baade2c3b1074 · OpenDAS / vllm_cscc · GitLab

21 Apr, 2026 1 commit

[Bugfix] Fix dataset name and path argument validation bug in vllm bench serve (#40288) · 7b1e0b07

Talor Abramovich authored Apr 21, 2026

Signed-off-by: talora <talora@nvidia.com>
Signed-off-by: Talor Abramovich <talor19@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

7b1e0b07

14 Apr, 2026 1 commit
- [Bugfix] Fix `vllm bench serve` to count multimodal tokens in "total input tokens" (#38654) · 1e4748c6
  Matthias Gehre authored Apr 14, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  1e4748c6
18 Mar, 2026 1 commit

Adding deterministic lora benchmarking to vLLM Bench (#36057) · c9d838fc

RonaldBXu authored Mar 18, 2026


Signed-off-by: Ubuntu <ubuntu@ip-172-31-43-201.ap-northeast-1.compute.internal>
Signed-off-by: Ronald Xu <ronaldxu@amazon.com>

c9d838fc

09 Mar, 2026 1 commit
- [Bug] Fix pooling model benchmark script (#36300) · be292b7c
  Wentao Ye authored Mar 09, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  be292b7c
05 Mar, 2026 1 commit
- [Bugfix] Fix Qwen-VL tokenizer implementation (#36140) · 71963481
  Cyrus Leung authored Mar 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  71963481
26 Feb, 2026 1 commit
- [Benchmarks] Plot benchmark timeline and requests statistics (#35220) · 02acd168
  Sophie du Couédic authored Feb 26, 2026
```
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  02acd168
11 Feb, 2026 1 commit
- [Redo] Add `--trust-remote-code` to dataset bench args (#34251) · 3bcd494e
  Cyrus Leung authored Feb 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3bcd494e
10 Feb, 2026 4 commits
- Support benchmarking of Geospatial models (#33922) · 599e4335
  mgazz authored Feb 10, 2026
```
Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
```
  599e4335
- add --insecure arg to the vllm bench to skip TLS (#34026) · a1946570
  Fan Yang authored Feb 10, 2026
```
Signed-off-by: Fan Yang <yan9fan@meta.com>
Co-authored-by: Fan Yang <yan9fan@meta.com>
```
  a1946570
- Revert #34208 (#34216) · 998e2d91
  Cyrus Leung authored Feb 10, 2026
  
  998e2d91
- [Bugfix] Add `--trust-remote-code` to dataset bench args (#34208) · f69b903b
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f69b903b
09 Feb, 2026 1 commit

[ASR] Fix audio benchmark and add RTFx metric (#32300) · 1d5922fa

Ekagra Ranjan authored Feb 09, 2026


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

1d5922fa

22 Jan, 2026 2 commits
- [Benchmark] Don't default to `temperature==0` in `vllm bench serve` (#32723) · 098b2d66
  Nick Hill authored Jan 22, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  098b2d66
- [bench] add start_times field to vllm bench serve json result (#32667) · 1bf1a34b
  Kebe authored Jan 22, 2026
```
Signed-off-by: Kebe <mail@kebe7jun.com>
```
  1bf1a34b
12 Jan, 2026 1 commit
- [Misc] Disable default `--ready-check-timeout-sec` extra call in vllm bench (#30975) · 22970c16
  Nicolò Lucchesi authored Jan 12, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  22970c16
06 Jan, 2026 2 commits
- [Spec Decode][UX] Add acceptance stats to `vllm bench serve` report (#31739) · d4989973
  Matthew Bonanni authored Jan 06, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>
```
  d4989973
- Report error log after vllm bench serve (#31808) · dba95378
  Elvir Crnčević authored Jan 06, 2026
```
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
```
  dba95378
26 Dec, 2025 1 commit
- [benchmark] use model card root instead of id (#31329) · 3b8f31b3
  Ning Xie authored Dec 26, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  3b8f31b3
24 Dec, 2025 1 commit
- Revert "[bench] Support common prefix len config (for decode-only bench)" (#31240) · 3bb95619
  Ming Yang authored Dec 23, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3bb95619
17 Dec, 2025 1 commit
- [UX] Make `vllm bench serve` discover model by default and use --input-len (#30816) · 519ef9a9
  Michael Goin authored Dec 17, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  519ef9a9
14 Dec, 2025 1 commit
- [Bugfix][benchmarks] Fix input token calculation for rerank benchmark metrics (#30596) · add4b0ca
  Vensen authored Dec 14, 2025
```
Signed-off-by: vensen <vensenmu@gmail.com>
```
  add4b0ca
10 Dec, 2025 1 commit
- [Misc] Consistent case for `vllm bench serve` results (#30403) · 794a7875
  Matthew Bonanni authored Dec 10, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  794a7875
09 Dec, 2025 1 commit

[Cleanup] Refactor profiling env vars into a CLI config (#29912) · e858bfe0

Benjamin Chislett authored Dec 09, 2025

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e858bfe0

06 Dec, 2025 1 commit
- [Bugfix]: Fix `TokenizerLike` interface (#30009) · 40a046cd
  Rohan Potdar authored Dec 05, 2025
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  40a046cd
05 Dec, 2025 1 commit
- [bench] Support common prefix len config (for decode-only bench) (#29934) · f16356fe
  Ming Yang authored Dec 05, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  f16356fe
02 Dec, 2025 1 commit
- [Chore] Move tokenizer initialization methods (#29793) · 653591d5
  Cyrus Leung authored Dec 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  653591d5
27 Nov, 2025 1 commit
- [Doc]: fixing typos in diverse files (#29492) · 66d3d542
  Didier Durand authored Nov 27, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  66d3d542
16 Nov, 2025 1 commit
- [Bugfix] Fix host and port join for ipv6 in bench serve (#28679) · 3bc11757
  scottzh8 authored Nov 16, 2025
```
Signed-off-by: Scott Zhang <scottzh@fb.com>
Co-authored-by: Scott Zhang <scottzh@fb.com>
```
  3bc11757
10 Nov, 2025 1 commit
- [Perf] Move gc.freeze logic from EngineCoreProc to EngineCore for better coverage (#27896) · b30372cb
  Jialin Ouyang authored Nov 10, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  b30372cb
07 Nov, 2025 1 commit
- [Feature] Default `ignore_eos` True for `random` dataset (#28227) · 4b1ff132
  Wentao Ye authored Nov 07, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  4b1ff132
03 Nov, 2025 1 commit
- [Feature][Benchmarks] Support `inf` burstiness (#26941) · a4398fbb
  Sophie du Couédic authored Nov 03, 2025
```
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
```
  a4398fbb
31 Oct, 2025 1 commit
- [benchmark] Make request IDs unique across clients by default (#27723) · b2e65cb4
  Seiji Eicher authored Oct 30, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  b2e65cb4
17 Oct, 2025 2 commits
- [Docs] Replace `rst` style double-backtick with `md` single-backtick (#27091) · 6c9fdbf7
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c9fdbf7
- vllm bench serve shows num of failed requests (#26478) · 965c5f49
  Tomas Ruiz authored Oct 17, 2025
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  965c5f49
16 Oct, 2025 2 commits
- Adding Warmup to Benchmark Serving (#26943) · 013abde6
  kimbochen authored Oct 16, 2025
```
Signed-off-by: Kimbo Chen <chentenghung@gmail.com>
```
  013abde6
- [Benchmark] Show E2EL by default for pooling models (#27014) · 334535b6
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  334535b6
15 Oct, 2025 1 commit
- [Feature] default --extra-body param to disable thinking in vllm bench serve (#26784) · a27b288e
  rongfu.leng authored Oct 15, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  a27b288e
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
09 Oct, 2025 1 commit
- [Misc] Upgrade more code to Python 3.10 (#26463) · dc7976dd
  Cyrus Leung authored Oct 09, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  dc7976dd
06 Oct, 2025 1 commit
- [Benchmark] Enable MM Embedding benchmarks (#26310) · 44b9af5b
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44b9af5b