benchmarks/benchmark_serving.py · a62bc0109c3864b9dc770dc637e3acd332c730ea · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Misc] Add Gamma-Distribution Request Generation Support for Serving Benchmark. (#10105) · a62bc010
Atlas authored Nov 07, 2024
```
Signed-off-by: Mozhou <spli161006@gmail.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>
```
a62bc010

benchmark_serving.py 42.3 KB