Commits · c9d838fc338db9a5a23cb3906d17c47423c4c9e4 · OpenDAS / vllm_cscc

18 Mar, 2026 1 commit

Adding deterministic lora benchmarking to vLLM Bench (#36057) · c9d838fc

RonaldBXu authored Mar 18, 2026


Signed-off-by: Ubuntu <ubuntu@ip-172-31-43-201.ap-northeast-1.compute.internal>
Signed-off-by: Ronald Xu <ronaldxu@amazon.com>

c9d838fc

17 Mar, 2026 2 commits
- [Models] Cohere ASR (#35809) · b5ca9c35
  Ekagra Ranjan authored Mar 17, 2026
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  b5ca9c35
- [Chore] Replace all base64 usages with faster pybase64 package (#37290) · a836524d
  Isotr0py authored Mar 17, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a836524d
28 Feb, 2026 3 commits
- [Benchmark] Avoid unnecessary video download in MMVU (#35618) · 1dafb29f
  Cyrus Leung authored Mar 01, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1dafb29f
- custom dataset img support base64 (#35280) · c68e69f1
  flutist authored Feb 28, 2026
```
Signed-off-by: xjx <493337577@qq.com>
```
  c68e69f1
- [Bugfix] Fixes for SLA finder (#35537) · fd68cd13
  Cyrus Leung authored Feb 28, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  fd68cd13
21 Feb, 2026 1 commit
- [Benchmark] Improve benchmarks (#35012) · f74f1572
  Cyrus Leung authored Feb 21, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f74f1572
13 Feb, 2026 1 commit
- [Bugfix] Fix Random Dataset Prefix Length Inaccuracy (#33907) · b86bf441
  Frank Wang authored Feb 12, 2026
```
Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  b86bf441
11 Feb, 2026 1 commit
- [Redo] Add `--trust-remote-code` to dataset bench args (#34251) · 3bcd494e
  Cyrus Leung authored Feb 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3bcd494e
10 Feb, 2026 5 commits
- Support benchmarking of Geospatial models (#33922) · 599e4335
  mgazz authored Feb 10, 2026
```
Signed-off-by: Michele Gazzetti <michele.gazzetti1@ibm.com>
```
  599e4335
- [Bugfix] Fix `--trust-remote-code` conflict (#34218) · 2c32558a
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2c32558a
- Revert #34208 (#34216) · 998e2d91
  Cyrus Leung authored Feb 10, 2026
  
  998e2d91
- [responsesAPI] fix simpleContext streaming output_messages (#34188) · 9608844f
  Andrew Xia authored Feb 09, 2026
```
Signed-off-by: Andrew Xia <axia@meta.com>
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
  9608844f
- [Bugfix] Add `--trust-remote-code` to dataset bench args (#34208) · f69b903b
  Cyrus Leung authored Feb 10, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f69b903b
09 Feb, 2026 1 commit

[ASR] Fix audio benchmark and add RTFx metric (#32300) · 1d5922fa

Ekagra Ranjan authored Feb 09, 2026


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>

1d5922fa

02 Feb, 2026 1 commit

[Misc] support arbitrary MM datasets in spec dec bench (#33486) · ba871fb7

Komal Kumar Teru authored Feb 02, 2026


Signed-off-by: kkt-cohere <komal@cohere.com>
Signed-off-by: Komal Kumar Teru <162363718+kkt-cohere@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

ba871fb7

28 Jan, 2026 1 commit
- Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
  Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2eb673a0
19 Jan, 2026 1 commit
- feat: spec decode with draft models (#24322) · 4a5299c9
  Tomas Ruiz authored Jan 19, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  4a5299c9
09 Jan, 2026 1 commit
- [Feature][Benchmarks] Custom dataset: read output length from dataset (#31881) · b474782a
  Sophie du Couédic authored Jan 09, 2026
```
Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
```
  b474782a
07 Jan, 2026 1 commit
- [Frontend] Implement robust video frame recovery for corrupted videos (#29197) · 6f351548
  vSeamar authored Jan 06, 2026
```
Signed-off-by: cmartinez <cmartinez@roblox.com>
Signed-off-by: vSeamar <cmartinez@roblox.com>
```
  6f351548
02 Jan, 2026 1 commit

Add Multimodal Processor Benchmark (#29105) · 1f5b7c41

Reagan Lee authored Jan 01, 2026


Signed-off-by: Reagan Lee <reaganjlee@gmail.com>
Signed-off-by: Reagan <reaganjlee@gmail.com>

1f5b7c41

24 Dec, 2025 1 commit
- Revert "[bench] Support common prefix len config (for decode-only bench)" (#31240) · 3bb95619
  Ming Yang authored Dec 23, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3bb95619
06 Dec, 2025 1 commit
- [Bugfix]: Fix `TokenizerLike` interface (#30009) · 40a046cd
  Rohan Potdar authored Dec 05, 2025
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  40a046cd
05 Dec, 2025 1 commit
- [bench] Support common prefix len config (for decode-only bench) (#29934) · f16356fe
  Ming Yang authored Dec 05, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  f16356fe
29 Nov, 2025 1 commit
- [Misc] Refactor tokenizer interface (#29693) · 34a98427
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  34a98427
07 Nov, 2025 1 commit
- [FixBug]Aeala/ShareGPT_Vicuna_unfiltered marked as multimodal benchmark (#28265) · 315068eb
  汪志鹏 authored Nov 07, 2025
```
Signed-off-by: princepride <wangzhipeng628@gmail.com>
```
  315068eb
06 Nov, 2025 1 commit
- Make the cv2 dependency optional (#27780) · d72299d4
  Jacob Zhong authored Nov 06, 2025
```
Signed-off-by: Jacob <cmpute@qq.com>
```
  d72299d4
29 Oct, 2025 1 commit

Feature/video support in random mm dataset (#25963) · 5e72216d

Eugene Khvedchenya authored Oct 29, 2025


Signed-off-by: Eugene Khvedchenia <ekhvedchenia@nvidia.com>
Signed-off-by: Eugene Khvedchenya <ekhvedchenia@nvidia.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

5e72216d

26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

17 Oct, 2025 1 commit
- [Chore] Separate out `vllm.utils.importlib` (#27022) · 4d4d6bad
  Cyrus Leung authored Oct 17, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  4d4d6bad
16 Oct, 2025 1 commit
- [Bug] Add Assertion for `random-input-len` / `random-output-len` (#26834) · 23583ee2
  Wentao Ye authored Oct 16, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  23583ee2
15 Oct, 2025 1 commit
- [Bugfix] Fixes prefix-repetition benchmark script (#26828) · a2986b3e
  kourosh hakhamaneshi authored Oct 14, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <Kourosh@anyscale.com>
```
  a2986b3e
14 Oct, 2025 1 commit
- Add support for the /rerank endpoint in vllm bench serve (#26602) · fe3edb4c
  Maximilien de Bayser authored Oct 14, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
```
  fe3edb4c
12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
11 Oct, 2025 1 commit
- [Benchmark] Support Infinity API (#26641) · 5be7ca1b
  Cyrus Leung authored Oct 12, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5be7ca1b
06 Oct, 2025 3 commits
- [Benchmark] Enable MM Embedding benchmarks (#26310) · 44b9af5b
  Cyrus Leung authored Oct 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  44b9af5b
- [Misc] Clean up unnecessary E501 ignore (#26274) · 43c146ca
  Roger Wang authored Oct 06, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  43c146ca
- [Benchmarking] Add disable_shuffle option for dataset loading (#26258) · 7c2ec0fe
  Yasmin Moslem authored Oct 06, 2025
```
Signed-off-by: Yasmin Moslem <48152713+ymoslem@users.noreply.github.com>
```
  7c2ec0fe
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
03 Oct, 2025 1 commit

[Bug][Benchmark] Fix duplicate req in oversampling (#26140) · ad2d7880

Ekagra Ranjan authored Oct 02, 2025


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

ad2d7880