Skip to content

GitLab

Commit 2eba7620 authored by Rayyyyy's avatar Rayyyyy
Browse files

add evaluation result image

parent 223a7500
Hide whitespace changes
Inline Side-by-side
Showing with 4 additions and 1 deletion
README.md
View file @ 2eba7620
...@@ -141,7 +141,7 @@ torchrun --nproc_per_node 1 example_chat_completion.py \ ...@@ -141,7 +141,7 @@ torchrun --nproc_per_node 1 example_chat_completion.py \
--max_seq_len 512 --max_batch_size 6 --max_seq_len 512 --max_batch_size 6
``` ```
## 验证 ## Evaluation
1. 安装 `llama-recipes`、`lm-eval` 库 1. 安装 `llama-recipes`、`lm-eval` 库
```bash ```bash
# llama-recipes 下载 # llama-recipes 下载
...@@ -166,6 +166,9 @@ cd ../ ...@@ -166,6 +166,9 @@ cd ../
cd /path/of/llama-recipes/recipes/evaluation cd /path/of/llama-recipes/recipes/evaluation
python eval.py --model hf --model_args pretrained=/home/llama3/Meta-Llama-3-8B-Instruct,dtype="float" --tasks hellaswag --device cuda --batch_size 8 python eval.py --model hf --model_args pretrained=/home/llama3/Meta-Llama-3-8B-Instruct,dtype="float" --tasks hellaswag --device cuda --batch_size 8
``` ```
<div align=center>
<img src="./doc/evaluation.png"/>
</div>
## result ## result
- Meta-Llama-3-8B-Instruct - Meta-Llama-3-8B-Instruct
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment