Skip to content

GitLab

Unverified Commit d7f39648 authored by Ronen Schaffer's avatar Ronen Schaffer Committed by GitHub
Browse files

Update comment (#2934)

parent 8fbd84bf
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
benchmarks/benchmark_serving.py
View file @ d7f39648
...@@ -7,7 +7,7 @@ On the server side, run one of the following commands: ...@@ -7,7 +7,7 @@ On the server side, run one of the following commands:
--disable-log-requests --disable-log-requests
(TGI backend) (TGI backend)
./launch_hf_server.sh <your_model> ./launch_tgi_server.sh <your_model> <max_batch_total_tokens>
On the client side, run: On the client side, run:
python benchmarks/benchmark_serving.py \ python benchmarks/benchmark_serving.py \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment