Commits · 1cab2f9cad22807150c93b4b5635ff884884ca5a · OpenDAS / vllm_cscc

02 Oct, 2025 1 commit

EAGLE 3: Fix preamble so that measured speedup over Eagle 1 becomes 32%... · 1cab2f9c

Ekagra Ranjan authored Oct 02, 2025


EAGLE 3: Fix preamble so that measured speedup over Eagle 1 becomes 32% instead of 5% on MTBench (#25916)
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>

1cab2f9c

01 Oct, 2025 1 commit
- [Benchmark] Finish documented v0.11.0 deprecation of --endpoint-type (#26007) · f9e71481
  Nathan Scott authored Oct 01, 2025
```
Signed-off-by: Nathan Scott <nathans@redhat.com>
```
  f9e71481
30 Sep, 2025 1 commit
- [Benchmark] Support benchmark throughput for external launcher DP (#25913) · d3bd1711
  Zhuohan Li authored Sep 29, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  d3bd1711
28 Sep, 2025 1 commit

Fix random dataset mismatched token length with config. (#24937) · f4e4088c

weiliang authored Sep 28, 2025


Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>

f4e4088c

27 Sep, 2025 1 commit

[Multimodal][Speculative Decoding]Eagle Eagle3 mm support, enablement on qwen2.5vl (#22872) · f1d53d15

WeiQing Chen authored Sep 27, 2025


Signed-off-by: Junhong <liujunhong11@huawei.com>
Signed-off-by: Junhong Liu <98734602+LJH-LBJ@users.noreply.github.com>
Co-authored-by: Junhong <liujunhong11@huawei.com>
Co-authored-by: LJH-LBJ <98734602+LJH-LBJ@users.noreply.github.com>

f1d53d15

23 Sep, 2025 1 commit

[benchmarks]allow skip ready check for bench serve (#25420) · eea17839

Lucia Fang authored Sep 22, 2025


Signed-off-by: Lu Fang <fanglu@fb.com>
Signed-off-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>

eea17839

19 Sep, 2025 1 commit
- refactor(benchmarks): add type annotations to wait_for_endpoint parameters (#25218) · ce75e153
  samzong authored Sep 20, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  ce75e153
18 Sep, 2025 3 commits
- [Misc] Clean up flags in `vllm bench serve` (#25138) · 21da7334
  Roger Wang authored Sep 18, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  21da7334
- [Doc] Fix cross-reference warnings (#25058) · 05b044e6
  Punitvara authored Sep 18, 2025
```
Signed-off-by: Punit Vara <punitvara@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  05b044e6
- [benchmark] add peak throughput metrics and plot (#23867) · a904ea78
  Simon Mo authored Sep 17, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  a904ea78
17 Sep, 2025 4 commits
- [Docs] vllm/benchmarks/datasets.py fix docstring param format. (#24970) · 4a2d33e3
  samzong authored Sep 17, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  4a2d33e3
- [Docs] improve code formatting and comments for eliminate griffe build warning. (#25010) · 47f670b0
  samzong authored Sep 17, 2025
```
Signed-off-by: samzong <samzong.lu@gmail.com>
```
  47f670b0
- [Core] Remove tokenizer group in vLLM (#24078) · 6c47f6bf
  Zhuohan Li authored Sep 17, 2025
```
Signed-off-by: Zhuohan Li <zhuohan123@gmail.com>
```
  6c47f6bf
- [Benchmarks] Add MMVU video dataset support and clean up deprecated datasets (#24719) · 5a411ef6
  Isotr0py authored Sep 17, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  5a411ef6
14 Sep, 2025 1 commit
- [Benchmarks] Throw usage error when using dataset-name random and dataset-path together (#24819) · ff680359
  Ye (Charlotte) Qi authored Sep 14, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  ff680359
12 Sep, 2025 2 commits
- [Benchmark] Allow arbitrary headers to be passed to benchmarked endpoints (#23937) · bc636f21
  Clayton Coleman authored Sep 12, 2025
```
Signed-off-by: Clayton Coleman <smarterclayton@gmail.com>
```
  bc636f21
- [Doc]: fix typos in various files (#24726) · bcb06d7b
  Didier Durand authored Sep 12, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  bcb06d7b
11 Sep, 2025 1 commit
- Enable --profile in 'vllm bench throughput' (#24575) · ee0bc5e1
  Tomas Ruiz authored Sep 11, 2025
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  ee0bc5e1
09 Sep, 2025 2 commits
- [Benchmark] Add option to skip oversampling in benchmark (#24457) · fb1a8f93
  Ekagra Ranjan authored Sep 09, 2025
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
  fb1a8f93
- [Misc] Support bench serve long context (#24373) · 1823a00d
  Ming Yang authored Sep 08, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  1823a00d
08 Sep, 2025 3 commits

[Spec Decode] Fix offline spec_decode.py (#24257) · 41183c1f

Ekagra Ranjan authored Sep 08, 2025


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

41183c1f

[Spec Decode][Benchmark] Add Blitzedit dataset (#23605) · cd086369

Ekagra Ranjan authored Sep 08, 2025


Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

cd086369

[Spec Decode][Benchmark] Add Spec Bench Dataset for benchmarking (#23563) · 3feeeb9f
Ekagra Ranjan authored Sep 08, 2025
```
Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
```
3feeeb9f

03 Sep, 2025 1 commit
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
02 Sep, 2025 1 commit
- [Benchmark] Add support for local hf dataset path in benchmark (#23999) · c83c4ff8
  Jiangyun Zhu authored Sep 03, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  c83c4ff8
26 Aug, 2025 2 commits
- Fix writing benchmark results with tuple keys (#23633) · 6ace2f72
  Huy Do authored Aug 26, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  6ace2f72
- [Benchmarks] add benchmark for embedding models (#23000) · 3ecbb14b
  Jiangyun Zhu authored Aug 26, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  3ecbb14b
25 Aug, 2025 1 commit
- Feature/benchmark/random mm data/images (#23119) · 0cb7b065
  Breno Baldas Skuk authored Aug 25, 2025
```
Signed-off-by: breno.skuk <breno.skuk@hcompany.ai>
```
  0cb7b065
21 Aug, 2025 2 commits

[BugFix] Fix Python 3.9 Support (#23306) · 31282401

Jared O'Connell authored Aug 21, 2025

Signed-off-by: Jared O'Connell <46976761+jaredoconnell@users.noreply.github.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

31282401

[Bugfix] Fix extra whitespace in strings caused by newline (#23272) · 0c31e28e
Cyrus Leung authored Aug 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
0c31e28e

20 Aug, 2025 1 commit
- [CI/Build] Also check DP in benchmarks throughput script (#23038) · f7290232
  Zhewen Li authored Aug 19, 2025
```
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  f7290232
19 Aug, 2025 3 commits
- [Benchmarks] Add video inputs to ShareGPTDataset. (#23199) · 1630cc8d
  Chenheli Hua authored Aug 19, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  1630cc8d
- [Misc] Fix the benchmark's README and improve the error messages for the... · 03d4235f
  Ruixiang Tan authored Aug 20, 2025
```
[Misc] Fix the benchmark's README and improve the error messages for the benchmark's argument checks (#22654)
Signed-off-by: tanruixiang <tanruixiang0104@gmail.com>
```
  03d4235f
- [Misc] Add request_id into benchmark_serve.py (#23065) · 31436e8b
  hustxiayang authored Aug 19, 2025
```
Signed-off-by: yangxia <yangxiast@gmail.com>
```
  31436e8b
16 Aug, 2025 1 commit
- Add docs for PrefixRepetitionDataset + enable usage with `vllm bench throughput` (#23012) · de9cb617
  Seiji Eicher authored Aug 16, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  de9cb617
15 Aug, 2025 2 commits
- Add PrefixRepetitionRandomDataset to `vllm bench serve` datasets (#20638) · 00d6cba0
  Seiji Eicher authored Aug 15, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  00d6cba0
- [Benchmarks] Include image data when ShareGPT4V dataset is used. (#22955) · 993d3d12
  Chenheli Hua authored Aug 15, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  993d3d12
11 Aug, 2025 1 commit
- [Docs] Add comprehensive CLI reference for all large `vllm` subcommands (#22601) · bc1d02ac
  Harry Mellor authored Aug 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  bc1d02ac
10 Aug, 2025 1 commit
- Fix(benchmarks): allow multiple mm contents in OpenAI Chat Completion Benchmarks (#22534) · 65a7917b
  Breno Baldas Skuk authored Aug 10, 2025
```
Signed-off-by: breno.skuk <breno.skuk@hcompany.ai>
```
  65a7917b
08 Aug, 2025 1 commit
- [bench] Fix benchmark/serve.py to ignore unavailable results (#22382) · 808a7b69
  lkchen authored Aug 07, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  808a7b69