benchmarks/benchmark_serving.py · 4d3a2c284ecc47748273664c9a6ef302ff3adcbe · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Misc] Add tokenizer_mode param to benchmark_serving.py (#11174) · 238c0d93
Alexander Matveev authored Dec 13, 2024
```
Signed-off-by: Alexander Matveev <alexm@neuralmagic.com>
```
238c0d93

benchmark_serving.py 45.9 KB