benchmarks/benchmark_batch_invariance.py · 41199996658428e6780f99c1ffff3ecc3bc5cc91 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

Adding a benchmark for batch invariance (#28161) · f849ee73

Bram Wasti authored Nov 16, 2025

Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

f849ee73

benchmark_batch_invariance.py 13.1 KB