Skip to content

GitLab

Unverified Commit 345be0e2 authored by Philipp Schmid's avatar Philipp Schmid Committed by GitHub
Browse files

[benchmark] Update TGI version (#7917)

parent fc911880
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
benchmarks/launch_tgi_server.sh
View file @ 345be0e2
...@@ -6,7 +6,7 @@ TOKENS=$2 ...@@ -6,7 +6,7 @@ TOKENS=$2
docker run -e HF_TOKEN=$HF_TOKEN --gpus all --shm-size 1g -p $PORT:80 \ docker run -e HF_TOKEN=$HF_TOKEN --gpus all --shm-size 1g -p $PORT:80 \
-v $PWD/data:/data \ -v $PWD/data:/data \
ghcr.io/huggingface/text-generation-inference:1.4.0 \ ghcr.io/huggingface/text-generation-inference:2.2.0 \
--model-id $MODEL \ --model-id $MODEL \
--sharded false \ --sharded false \
--max-input-length 1024 \ --max-input-length 1024 \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment