benchmarks/backend_request_func.py · 53076d70e7e396b02befc79c92861b3fbce872d8 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

fix "Total generated tokens:" is 0 if using --backend tgi and --endpo… (#14673) · 40828ce5
Wang, Yi authored Mar 20, 2025
```
Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>
```
40828ce5

backend_request_func.py 18.4 KB