benchmarks/benchmark_long_document_qa_throughput.py · 0c6f9985547d6b510d34c6c873db54abe03eb346 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Benchmark] Add benchmark script for CPU offloading (#11533) · 0c6f9985
Yihua Cheng authored Dec 31, 2024
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
Co-authored-by: KuntaiDu <kuntai@uchicago.edu>
```
0c6f9985

benchmark_long_document_qa_throughput.py 6.37 KB