vllm/benchmarks/latency.py · 51e98e4ffd696289bce1ec92c78cc7298dc1600b · OpenDAS / vllm_cscc · GitLab

"vllm/vscode:/vscode.git/clone" did not exist on "176173989a4c5d9c3a4dca8c788d3492ac27a2e0"

Find file Blame History Permalink

[Bugfix] Disable prefix caching by default for benchmark (#18771) · 51e98e4f
cascade authored May 27, 2025
```
Signed-off-by: cascade812 <cascade812@outlook.com>
```
51e98e4f

latency.py 6.41 KB