Commit bf0dbb2e authored by Rayyyyy's avatar Rayyyyy
Browse files

update README

parent 2eba7620
......@@ -151,9 +151,12 @@ cd ./llama-recipes/recipes/evaluation/
from lm_eval.evaluator import make_table
# 修改eval.py第121行代码,num_fewshot参数的默认值改为0
default=0
# 修改eval.py第215行代码,use_cache=args.use_cache 修改为
no_cache=args.use_cache
# 返回根目录
cd ~
# lm-eval 下载
git clone http://developer.hpccube.com/codes/chenych/lm-evaluation-harness.git
cd ./lm-evaluation-harness/
......@@ -163,7 +166,7 @@ cd ../
2. 修改待测模型**pretrained**参数地址,例如 `/home/Meta-Llama-3-8B-Instruct`,特别地,当前仅支持`hellaswag`数据集进行测试验证。执行以下命令:
```bash
cd /path/of/llama-recipes/recipes/evaluation
cd /path_of/llama-recipes/recipes/evaluation
python eval.py --model hf --model_args pretrained=/home/llama3/Meta-Llama-3-8B-Instruct,dtype="float" --tasks hellaswag --device cuda --batch_size 8
```
<div align=center>
......@@ -271,3 +274,4 @@ huggingface-cli download meta-llama/Meta-Llama-3-70B-Instruct --include "origina
- https://github.com/meta-llama/llama3
- https://github.com/InternLM/xtuner
- https://github.com/SmartFlowAI/EmoLLM
- https://github.com/meta-llama/llama-recipes
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment