Unverified Commit 676db55e authored by Junru Shen's avatar Junru Shen Committed by GitHub
Browse files

[Bugfix] Fix prefix_repetition routing in bench throughput (#29663)


Signed-off-by: default avatarJunru Shen <jrshen.sjr@gmail.com>
Co-authored-by: default avatargemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
parent 0e391e75
...@@ -346,7 +346,10 @@ def get_requests(args, tokenizer): ...@@ -346,7 +346,10 @@ def get_requests(args, tokenizer):
"output_len": args.output_len, "output_len": args.output_len,
} }
if args.dataset_path is None or args.dataset_name == "random": if args.dataset_name == "random" or (
args.dataset_path is None
and args.dataset_name not in {"prefix_repetition", "random-mm", "random-rerank"}
):
sample_kwargs["range_ratio"] = args.random_range_ratio sample_kwargs["range_ratio"] = args.random_range_ratio
sample_kwargs["prefix_len"] = args.prefix_len sample_kwargs["prefix_len"] = args.prefix_len
dataset_cls = RandomDataset dataset_cls = RandomDataset
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment