Commit c23539c9 authored by chenzk's avatar chenzk
Browse files

Update sf.md

parent 34794993
...@@ -38,7 +38,7 @@ pip install -e . ...@@ -38,7 +38,7 @@ pip install -e .
``` ```
### Anaconda(方法三) ### Anaconda(方法三)
关于本项目DCU显卡所需的特殊深度学习库可从[光合](https://developer.hpccube.com/tool/)开发者社区下载安装。 关于本项目DCU显卡所需的特殊深度学习库可从[光合](https://developer.sourcefind.cn/tool/)开发者社区下载安装。
```bash ```bash
DTK驱动: dtk24.04 DTK驱动: dtk24.04
python: python3.10 python: python3.10
...@@ -97,7 +97,7 @@ NPROC_PER_NODE=${DCU_NUM} xtuner train ./llama3_8b_instruct_qlora_alpaca_e3_M.py ...@@ -97,7 +97,7 @@ NPROC_PER_NODE=${DCU_NUM} xtuner train ./llama3_8b_instruct_qlora_alpaca_e3_M.py
1. 训练库安装(**非llama3_pytorch目录下**),安装版本为**v0.6.3**`Llama-Factory`具体安装方法请参考仓库的README。 1. 训练库安装(**非llama3_pytorch目录下**),安装版本为**v0.6.3**`Llama-Factory`具体安装方法请参考仓库的README。
``` ```
git clone -b v0.6.3 http://developer.hpccube.com/codes/OpenDAS/llama-factory.git git clone -b v0.6.3 http://developer.sourcefind.cn/codes/OpenDAS/llama-factory.git
``` ```
2. 通过[预训练权重](#预训练权重)下载预训练模型,当前用例使用[Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct)模型; 2. 通过[预训练权重](#预训练权重)下载预训练模型,当前用例使用[Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct)模型;
...@@ -212,13 +212,13 @@ bash chat.sh ...@@ -212,13 +212,13 @@ bash chat.sh
1. 安装`llama-recipes``lm-eval` 1. 安装`llama-recipes``lm-eval`
```bash ```bash
# llama-recipes 下载 # llama-recipes 下载
git clone http://developer.hpccube.com/codes/chenych/llama-recipes.git git clone http://developer.sourcefind.cn/codes/chenych/llama-recipes.git
cd llama-recipes cd llama-recipes
# 移动exact_match.py文件 # 移动exact_match.py文件
mv exact_match.py ~/.cache/huggingface/evaluate/downloads/ mv exact_match.py ~/.cache/huggingface/evaluate/downloads/
cd ../ cd ../
# lm-eval 下载 # lm-eval 下载
git clone http://developer.hpccube.com/codes/chenych/lm-evaluation-harness.git git clone http://developer.sourcefind.cn/codes/chenych/lm-evaluation-harness.git
cd ./lm-evaluation-harness/ cd ./lm-evaluation-harness/
pip install -e . pip install -e .
``` ```
...@@ -355,7 +355,7 @@ python eval.py --model hf --model_args pretrained=/home/llama3/Meta-Llama-3-8B-I ...@@ -355,7 +355,7 @@ python eval.py --model hf --model_args pretrained=/home/llama3/Meta-Llama-3-8B-I
``` ```
## 源码仓库及问题反馈 ## 源码仓库及问题反馈
- https://developer.hpccube.com/codes/modelzoo/llama3_pytorch - https://developer.sourcefind.cn/codes/modelzoo/llama3_pytorch
## 参考资料 ## 参考资料
- https://github.com/meta-llama/llama3 - https://github.com/meta-llama/llama3
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment