Commit bf0dbb2e authored by Rayyyyy's avatar Rayyyyy
Browse files

update README

parent 2eba7620
...@@ -151,9 +151,12 @@ cd ./llama-recipes/recipes/evaluation/ ...@@ -151,9 +151,12 @@ cd ./llama-recipes/recipes/evaluation/
from lm_eval.evaluator import make_table from lm_eval.evaluator import make_table
# 修改eval.py第121行代码,num_fewshot参数的默认值改为0 # 修改eval.py第121行代码,num_fewshot参数的默认值改为0
default=0 default=0
# 修改eval.py第215行代码,use_cache=args.use_cache 修改为
no_cache=args.use_cache
# 返回根目录 # 返回根目录
cd ~ cd ~
# lm-eval 下载 # lm-eval 下载
git clone http://developer.hpccube.com/codes/chenych/lm-evaluation-harness.git git clone http://developer.hpccube.com/codes/chenych/lm-evaluation-harness.git
cd ./lm-evaluation-harness/ cd ./lm-evaluation-harness/
...@@ -163,7 +166,7 @@ cd ../ ...@@ -163,7 +166,7 @@ cd ../
2. 修改待测模型**pretrained**参数地址,例如 `/home/Meta-Llama-3-8B-Instruct`,特别地,当前仅支持`hellaswag`数据集进行测试验证。执行以下命令: 2. 修改待测模型**pretrained**参数地址,例如 `/home/Meta-Llama-3-8B-Instruct`,特别地,当前仅支持`hellaswag`数据集进行测试验证。执行以下命令:
```bash ```bash
cd /path/of/llama-recipes/recipes/evaluation cd /path_of/llama-recipes/recipes/evaluation
python eval.py --model hf --model_args pretrained=/home/llama3/Meta-Llama-3-8B-Instruct,dtype="float" --tasks hellaswag --device cuda --batch_size 8 python eval.py --model hf --model_args pretrained=/home/llama3/Meta-Llama-3-8B-Instruct,dtype="float" --tasks hellaswag --device cuda --batch_size 8
``` ```
<div align=center> <div align=center>
...@@ -271,3 +274,4 @@ huggingface-cli download meta-llama/Meta-Llama-3-70B-Instruct --include "origina ...@@ -271,3 +274,4 @@ huggingface-cli download meta-llama/Meta-Llama-3-70B-Instruct --include "origina
- https://github.com/meta-llama/llama3 - https://github.com/meta-llama/llama3
- https://github.com/InternLM/xtuner - https://github.com/InternLM/xtuner
- https://github.com/SmartFlowAI/EmoLLM - https://github.com/SmartFlowAI/EmoLLM
- https://github.com/meta-llama/llama-recipes
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment