benchmarks/benchmark_throughput.py · 5c4471ef64c176b709ea3fe5ae62afb2355c8b3c · OpenDAS / vllm_cscc · GitLab

"vscode:/vscode.git/clone" did not exist on "b0651021e5c042e0893929e1b80cf367c6611708"

Find file Blame History Permalink

Remove hardcoded `device="cuda" ` to support more devices (#2503) · 96b6f475
Kunshang Ji authored Feb 02, 2024
```
Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
96b6f475

benchmark_throughput.py 12.3 KB