Commits · 9502c38138a03669c4d54225336553db70ad799d · OpenDAS / vllm_cscc

26 Jun, 2025 1 commit
- [Benchmark][Bug] Fix multiple bugs in bench and add args to spec_decode offline (#20083) · 9502c381
  Ekagra Ranjan authored Jun 26, 2025
  
  9502c381
24 Jun, 2025 1 commit

[Misc][Benchmarking] Add variable request-rate ("ramp-up") to the benchmarking client. (#19423) · c635c5f7

d.transposed authored Jun 24, 2025

Signed-off-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Co-authored-by: Roger Wang <hey@rogerw.me>

c635c5f7

22 Jun, 2025 1 commit

[Benchmark] fix request loss if "ping" is returned (#19535) · 202c5df9

Wang, Yi authored Jun 22, 2025


Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

202c5df9

20 Jun, 2025 1 commit
- [Benchmark] Fix `Value of type "SampleRequest" is not indexable` (#18032) · 5aa4a015
  Brayden Zhong authored Jun 20, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  5aa4a015
12 Jun, 2025 1 commit
- [Spec Decode][Benchmark] Generalize spec decode offline benchmark to more... · 017ef648
  Ekagra Ranjan authored Jun 12, 2025
```
[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847)
```
  017ef648
04 Jun, 2025 1 commit
- [Misc] Add packages for benchmark as extra dependency (#19089) · 8711bc5e
  Isotr0py authored Jun 04, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  8711bc5e
03 Jun, 2025 3 commits
- [V1][Spec Decode][Ngram] 1.35x gain -> 1.95x gain on InstructCoder with prompt fix (#18971) · 135cf55c
  Ekagra Ranjan authored Jun 03, 2025
  
  135cf55c
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- Reduce logs in CLI scripts and plugin loader (#18970) · cc977286
  Michael Goin authored Jun 03, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  cc977286
31 May, 2025 1 commit
- [Misc][Benchmark] Add support for CustomDataset (#18511) · bbfa0c61
  Ekagra Ranjan authored May 31, 2025
  
  bbfa0c61
28 May, 2025 2 commits
- [V1] fix torch profiling for V1 offline scenarios (#18445) · 774c5fde
  Divakar Verma authored May 27, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  774c5fde
- [Bugfix] Disable prefix caching by default for benchmark (#18771) · 51e98e4f
  cascade authored May 27, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  51e98e4f
27 May, 2025 2 commits
- Support datasets in `vllm bench serve` and sync with benchmark_[serving,datasets].py (#18566) · e56f44d9
  Michael Goin authored May 27, 2025
  
  e56f44d9
- Disable prefix cache by default for benchmark (#18639) · aaa4ac1c
  cascade authored May 27, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
  aaa4ac1c
23 May, 2025 2 commits
- [Doc] Fix top-level API links/docs (#18621) · 273cb3b4
  Cyrus Leung authored May 24, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  273cb3b4
- Re-submit: Fix: Proper RGBA -> RGB conversion for PIL images. (#18569) · 04eb88dc
  Chenheli Hua authored May 22, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  04eb88dc
12 May, 2025 1 commit
- [Fix] Benchmark `"EngineClient" has no attribute "model_config"` (#17976) · 891b9d33
  Brayden Zhong authored May 12, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  891b9d33
06 May, 2025 1 commit

[Misc] Add Next Edit Prediction (NEP) datasets support in `benchmark_serving.py` (#16839) · d456aea7

d.transposed authored May 06, 2025

Signed-off-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>
Signed-off-by: dtransposed <>
Co-authored-by: dtransposed <damian@damian-ml-machine.europe-west3-b.c.jetbrains-grazie.internal>

d456aea7

25 Apr, 2025 1 commit
- Fix Python packaging edge cases (#17159) · 65e262b9
  Christian Heimes authored Apr 26, 2025
```
Signed-off-by: Christian Heimes <christian@python.org>
```
  65e262b9
15 Apr, 2025 1 commit
- Add `vllm bench [latency, throughput]` CLI commands (#16508) · b4fe16c7
  Michael Goin authored Apr 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  b4fe16c7
09 Apr, 2025 1 commit
- [BugFix] fix some typos found by typos. (#16314) · 04149cce
  yihong authored Apr 09, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  04149cce
28 Mar, 2025 1 commit
- [Misc] cli auto show default value (#15582) · 26df46ee
  Reid authored Mar 29, 2025
```
Signed-off-by: reidliu41 <reid201711@gmail.com>
```
  26df46ee
12 Mar, 2025 1 commit

[Feature] Add `vllm bench` CLI (#13993) · 36e0c8f7

Randy Chen authored Mar 11, 2025


Signed-off-by: Randy Chen <acad.randyjhc@gmail.com>
Signed-off-by: Cody Yu <hao.yu.cody@gmail.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

36e0c8f7