Skip to content

GitLab

Unverified Commit abbbc187 authored by Hongkuan Zhou's avatar Hongkuan Zhou Committed by GitHub
Browse files

fix: update aiperf commands for trace dataset (#3737) 


Signed-off-by: default avatarhongkuanz <hongkuanz@nvidia.com>
parent a665886a
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 3 deletions
tests/planner/README.md
View file @ abbbc187
......@@ -224,9 +224,9 @@ aiperf profile \
--endpoint-type chat \
--url localhost:8000 \ # or the port-forwarded port
--streaming \
--input-file payload:/workspace/rr-5-45_i3000o300.jsonl \ # path to the generated load dataset \
--fixed-schedule True \
--goodput time_to_first_token:200 inter_token_latency:10 \
--input-file /workspace/rr-5-45_i3000o300.jsonl \ # path to the generated load dataset \
--custom-dataset-type mooncake_trace \
--goodput "time_to_first_token:200 inter_token_latency:10" \
-v
```
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment