Skip to content

GitLab

Unverified Commit bab8f3dd authored by Woosuk Kwon's avatar Woosuk Kwon Committed by GitHub
Browse files

[Minor] Fix benchmark_throughput.py (#151)

parent eedb46bf
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
benchmarks/benchmark_throughput.py
View file @ bab8f3dd
...@@ -97,6 +97,7 @@ def run_cacheflow( ...@@ -97,6 +97,7 @@ def run_cacheflow(
# FIXME(woosuk): Do not use internal method. # FIXME(woosuk): Do not use internal method.
llm._add_request( llm._add_request(
prompt=prompt, prompt=prompt,
prompt_token_ids=None,
sampling_params=sampling_params, sampling_params=sampling_params,
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment