Skip to content

GitLab

Unverified Commit b783c1cb authored by Binyao Jiang's avatar Binyao Jiang Committed by GitHub
Browse files

Fix hicache benchmark script bug - some sampled input_request is [] (#7300)

parent 094c116f
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 2 deletions
benchmark/hicache/data_processing.py
View file @ b783c1cb
...@@ -83,8 +83,9 @@ def common_filter_chat( ...@@ -83,8 +83,9 @@ def common_filter_chat(
input_tokens += prompt_len input_tokens += prompt_len
output_tokens += output_len output_tokens += output_len
processed.append((prompt, prompt_len, output_len)) processed.append((prompt, prompt_len, output_len))
filtered_dataset.append(processed) if len(processed) != 0:
l += 1 filtered_dataset.append(processed)
l += 1
print(f"#Input tokens: {input_tokens}") print(f"#Input tokens: {input_tokens}")
print(f"#Output tokens: {output_tokens}") print(f"#Output tokens: {output_tokens}")
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment