Commits · 8b6725b0cf4ee5f363218f4bc341970c80297ccf · OpenDAS / vllm_cscc

"csrc/quantization/fp8/amd" did not exist on "241b4cfe6609adce0e72b9299d4f2e31150a6d86"

16 Nov, 2024 1 commit
- [Misc] Update benchmark to support image_url file or http (#10287) · 8b6725b0
  Jaehyun An authored Nov 16, 2024
```
Signed-off-by: rbbang <anjaehyun87@gmail.com>
```
  8b6725b0
07 Nov, 2024 1 commit
- [Misc] Add Gamma-Distribution Request Generation Support for Serving Benchmark. (#10105) · a62bc010
  Atlas authored Nov 07, 2024
```
Signed-off-by: Mozhou <spli161006@gmail.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
  a62bc010
04 Nov, 2024 1 commit
- [Bugfix] Fix E2EL mean and median stats (#9984) · ea4adedd
  Tran Quang Dai authored Nov 04, 2024
```
Signed-off-by: daitran2k1 <tranquangdai7a@gmail.com>
```
  ea4adedd
20 Oct, 2024 1 commit
- [Frontend][Misc] Goodput metric support (#9338) · 855e0e6f
  Andy Dai authored Oct 20, 2024
  
  855e0e6f
18 Oct, 2024 1 commit
- [Misc] benchmark: Add option to set max concurrency (#9390) · 7dbe738d
  Russell Bryant authored Oct 18, 2024
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  7dbe738d
17 Oct, 2024 1 commit
- [Bugfix] Add random_seed to sample_hf_requests in benchmark_serving script (#9013) · d65049da
  Kai Wu authored Oct 17, 2024
```
Co-authored-by: Isotr0py <2037008807@qq.com>
```
  d65049da
15 Oct, 2024 1 commit
- pass ignore_eos parameter to all benchmark_serving calls (#9349) · 5d264f4a
  Grace Ho authored Oct 15, 2024
  
  5d264f4a
11 Oct, 2024 1 commit
- [Misc] Fix sampling from sonnet for long context case (#9235) · 94bf9ae4
  Andy Dai authored Oct 10, 2024
  
  94bf9ae4
07 Oct, 2024 1 commit
- [core] remove beam search from the core (#9105) · 18b296fd
  youkaichao authored Oct 06, 2024
  
  18b296fd
04 Oct, 2024 1 commit
- [CI] Update performance benchmark: upgrade trt-llm to r24.07, and add SGLang (#7412) · fbb74420
  Kuntai Du authored Oct 04, 2024
  
  fbb74420
01 Oct, 2024 1 commit

Update benchmark_serving.py to read and write json-datasets, results in UTF8,... · 22f5851b

vlsav authored Oct 01, 2024

Update benchmark_serving.py to read and write json-datasets, results in UTF8, for better compatibility with Windows (#8997)

22f5851b

28 Sep, 2024 1 commit
- [Bugfix] Support testing prefill throughput with benchmark_serving.py --hf-output-len 1 (#8891) · e585b583
  Chen Zhang authored Sep 28, 2024
  
  e585b583
27 Sep, 2024 1 commit
- [MISC] Fix invalid escape sequence '\' (#8830) · 0e088750
  Peter Pan authored Sep 27, 2024
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  0e088750
19 Sep, 2024 1 commit
- [Bugfix] fixing sonnet benchmark bug in benchmark_serving.py (#8616) · c52ec5f0
  Kuntai Du authored Sep 18, 2024
  
  c52ec5f0
17 Sep, 2024 1 commit
- [Benchmark] Support sample from HF datasets and image input for benchmark_serving (#8495) · 1b6de835
  Isotr0py authored Sep 17, 2024
  
  1b6de835
07 Sep, 2024 1 commit
- Enable Random Prefix Caching in Serving Profiling Tool (benchmark_serving.py) (#8241) · 795b662c
  Wei-Sheng Chin authored Sep 06, 2024
  
  795b662c
06 Sep, 2024 1 commit
- [Frontend] Add --logprobs argument to `benchmark_serving.py` (#8191) · e5cab715
  afeldman-nm authored Sep 06, 2024
  
  e5cab715
04 Sep, 2024 1 commit
- [MISC] Replace input token throughput with total token throughput (#8164) · 77d9e514
  Cody Yu authored Sep 04, 2024
```
Co-authored-by: Michael Goin <michael@neuralmagic.com>
```
  77d9e514
29 Aug, 2024 1 commit
- Add more percentiles and latencies (#7759) · 0c785d34
  Wei-Sheng Chin authored Aug 29, 2024
  
  0c785d34
21 Aug, 2024 1 commit
- [misc] Add Torch profiler support (#7451) · dd53c4b0
  William Lin authored Aug 21, 2024
```
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
  dd53c4b0
15 Jul, 2024 1 commit
- [Bugfix] Benchmark serving script used global parameter 'args' in function... · ccb20db8
  Fish authored Jul 15, 2024
```
[Bugfix] Benchmark serving script used global parameter 'args' in function 'sample_random_requests' (#6428)
```
  ccb20db8
14 Jul, 2024 1 commit
- [Feature] vLLM CLI (#5090) · dbfe254e
  Ethan Xu authored Jul 14, 2024
```
Co-authored-by: simon-mo <simon.mo@hey.com>
```
  dbfe254e
11 Jul, 2024 1 commit
- [CI/Build] Add nightly benchmarking for tgi, tensorrt-llm and lmdeploy (#5362) · a4feba92
  Kuntai Du authored Jul 11, 2024
  
  a4feba92
08 Jul, 2024 1 commit
- Feature/add benchmark testing (#5947) · 717f4bce
  Haichuan authored Jul 08, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  717f4bce
07 Jul, 2024 1 commit
- add benchmark for fix length input and output (#5857) · 333306a2
  Haichuan authored Jul 07, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  333306a2
20 Jun, 2024 1 commit
- [Frontend] Add FlexibleArgumentParser to support both underscore and dash in names (#5718) · 8065a7e2
  Michael Goin authored Jun 20, 2024
  
  8065a7e2
17 Jun, 2024 1 commit
- [Misc] use AutoTokenizer for benchmark serving when vLLM not installed (#5588) · 1f12122b
  zhyncs authored Jun 18, 2024
  
  1f12122b
15 Jun, 2024 1 commit
- [mypy] Enable type checking for test directory (#5017) · 0e9164b4
  Cyrus Leung authored Jun 15, 2024
  
  0e9164b4
14 Jun, 2024 1 commit

[CI/Build][Misc] Add CI that benchmarks vllm performance on those PRs with... · 319ad7f1

Kuntai Du authored Jun 13, 2024


[CI/Build][Misc] Add CI that benchmarks vllm performance on those PRs with `perf-benchmarks` label (#5073)
Co-authored-by: simon-mo <simon.mo@hey.com>

319ad7f1

05 Jun, 2024 1 commit
- [misc] benchmark_serving.py -- add ITL results and tweak TPOT results (#5263) · 02cc3b51
  Tyler Michael Smith authored Jun 05, 2024
  
  02cc3b51
25 May, 2024 1 commit
- [Misc] Make Serving Benchmark More User-friendly (#5044) · f17a1a8f
  Roger Wang authored May 25, 2024
  
  f17a1a8f
20 May, 2024 1 commit
- [Doc]Add documentation to benchmarking script when running TGI (#4920) · c3af4472
  Kuntai Du authored May 20, 2024
  
  c3af4472
24 Apr, 2024 1 commit
- [Misc] Update ShareGPT Dataset Sampling in Serving Benchmark (#4279) · 7923dcad
  Roger Wang authored Apr 24, 2024
  
  7923dcad
04 Apr, 2024 1 commit
- [Bugfix] Fix args in benchmark_serving (#3836) · 819a309c
  Chang Su authored Apr 04, 2024
```
Co-authored-by: Roger Wang <ywang@roblox.com>
```
  819a309c
27 Mar, 2024 1 commit
- feat(benchmarks): Add Prefix Caching Benchmark to Serving Benchmark (#3277) · 45b6ef65
  Roger Wang authored Mar 27, 2024
  
  45b6ef65
25 Mar, 2024 1 commit
- [CI] Try introducing isort. (#3495) · 01bfb22b
  SangBin Cho authored Mar 25, 2024
  
  01bfb22b
16 Mar, 2024 1 commit
- [Misc] fix line length for entire codebase (#3444) · 8e67598a
  Simon Mo authored Mar 16, 2024
  
  8e67598a
08 Mar, 2024 1 commit
- [Minor Fix] Fix comments in benchmark_serving (#3252) · 1ece1ae8
  TianYu GUO authored Mar 08, 2024
  
  1ece1ae8
22 Feb, 2024 2 commits
- chore(vllm): codespell for spell checking (#2820) · 93dc5a28
  Massimiliano Pronesti authored Feb 22, 2024
  
  93dc5a28
- Update comment (#2934) · d7f39648
  Ronen Schaffer authored Feb 22, 2024
  
  d7f39648