Skip to content

GitLab

Unverified Commit 717f4bce authored by Haichuan's avatar Haichuan Committed by GitHub
Browse files

Feature/add benchmark testing (#5947) 


Co-authored-by: default avatarRoger Wang <ywang@roblox.com>
parent 16620f43
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 3 deletions
benchmarks/benchmark_serving.py
View file @ 717f4bce
...@@ -483,10 +483,10 @@ def main(args: argparse.Namespace): ...@@ -483,10 +483,10 @@ def main(args: argparse.Namespace):
elif args.dataset_name == "random": elif args.dataset_name == "random":
input_requests = sample_random_requests( input_requests = sample_random_requests(
input_len=args.input_len, input_len=args.random_input_len,
output_len=args.output_len, output_len=args.random_output_len,
num_prompts=args.num_prompts, num_prompts=args.num_prompts,
range_ratio=args.range_ratio, range_ratio=args.random_range_ratio,
tokenizer=tokenizer, tokenizer=tokenizer,
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment