Skip to content

GitLab

Unverified Commit b783c1cb authored by Binyao Jiang's avatar Binyao Jiang Committed by GitHub
Browse files

Fix hicache benchmark script bug - some sampled input_request is [] (#7300)

parent 094c116f
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 2 deletions
benchmark/hicache/data_processing.py
View file @ b783c1cb
...@@ -83,6 +83,7 @@ def common_filter_chat( ...@@ -83,6 +83,7 @@ def common_filter_chat(
input_tokens += prompt_len input_tokens += prompt_len
output_tokens += output_len output_tokens += output_len
processed.append((prompt, prompt_len, output_len)) processed.append((prompt, prompt_len, output_len))
if len(processed) != 0:
filtered_dataset.append(processed) filtered_dataset.append(processed)
l += 1 l += 1
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment