Skip to content

GitLab

"git@developer.sourcefind.cn:cnjsdfcy/simbricks.git" did not exist on "b86ff3a487a9e9eddcc8a6963426c7aa0c770846"
Commit 807d4470 authored by huangwb's avatar huangwb
Browse files

Merge branch 'format_1' into '0.2.5.rc1' 

format readme

See merge request dcutoolkit/deeplearing/opencompass!4
parents e6288ec7 b7d2607e
Pipeline #1249 failed with stages
in 0 seconds
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 2 deletions
README.md
View file @ 807d4470
...@@ -123,6 +123,7 @@ python run.py configs/tgi/eval_llama2_tgi.py --debug ...@@ -123,6 +123,7 @@ python run.py configs/tgi/eval_llama2_tgi.py --debug
HIP_VISIBLE_DEVICES=3 text-generation-launcher --dtype=float16 --model-id /data/models/Llama-2-7b-chat-hf --port 3001 --tokenizer-config-path /path/to/tokenizer_config_llama2_7b_chat.json HIP_VISIBLE_DEVICES=3 text-generation-launcher --dtype=float16 --model-id /data/models/Llama-2-7b-chat-hf --port 3001 --tokenizer-config-path /path/to/tokenizer_config_llama2_7b_chat.json
``` ```
注意：和base模型比多了`--tokenizer-config-path`参数。 注意：和base模型比多了`--tokenizer-config-path`参数。
运行评测example： 运行评测example：
```shell ```shell
python run.py configs/tgi/eval_llama2_7b_chat_tgi.py.py --debug python run.py configs/tgi/eval_llama2_7b_chat_tgi.py.py --debug
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment