benchmarks/benchmark_latency.py · 1d967acb45d5d18434409b822f105f087e379eee · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Bugfix] fix beam search input errors and latency benchmark script (#11875) · 1d967acb
Ye (Charlotte) Qi authored Jan 09, 2025
```
Signed-off-by: Ye Qi <yeq@meta.com>
Co-authored-by: yeq <yeq@devgpu004.lla3.facebook.com>
```
1d967acb

benchmark_latency.py 5.28 KB