Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
llama3_pytorch
Commits
c23539c9
Commit
c23539c9
authored
May 07, 2025
by
chenzk
Browse files
Update sf.md
parent
34794993
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
5 deletions
+5
-5
README.md
README.md
+5
-5
No files found.
README.md
View file @
c23539c9
...
@@ -38,7 +38,7 @@ pip install -e .
...
@@ -38,7 +38,7 @@ pip install -e .
```
```
### Anaconda(方法三)
### Anaconda(方法三)
关于本项目DCU显卡所需的特殊深度学习库可从
[
光合
](
https://developer.
hpccube.com
/tool/
)
开发者社区下载安装。
关于本项目DCU显卡所需的特殊深度学习库可从
[
光合
](
https://developer.
sourcefind.cn
/tool/
)
开发者社区下载安装。
```
bash
```
bash
DTK驱动: dtk24.04
DTK驱动: dtk24.04
python: python3.10
python: python3.10
...
@@ -97,7 +97,7 @@ NPROC_PER_NODE=${DCU_NUM} xtuner train ./llama3_8b_instruct_qlora_alpaca_e3_M.py
...
@@ -97,7 +97,7 @@ NPROC_PER_NODE=${DCU_NUM} xtuner train ./llama3_8b_instruct_qlora_alpaca_e3_M.py
1.
训练库安装(
**非llama3_pytorch目录下**
),安装版本为
**v0.6.3**
,
`Llama-Factory`
具体安装方法请参考仓库的README。
1.
训练库安装(
**非llama3_pytorch目录下**
),安装版本为
**v0.6.3**
,
`Llama-Factory`
具体安装方法请参考仓库的README。
```
```
git clone -b v0.6.3 http://developer.
hpccube.com
/codes/OpenDAS/llama-factory.git
git clone -b v0.6.3 http://developer.
sourcefind.cn
/codes/OpenDAS/llama-factory.git
```
```
2.
通过
[
预训练权重
](
#预训练权重
)
下载预训练模型,当前用例使用
[
Meta-Llama-3-8B-Instruct
](
https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct
)
模型;
2.
通过
[
预训练权重
](
#预训练权重
)
下载预训练模型,当前用例使用
[
Meta-Llama-3-8B-Instruct
](
https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct
)
模型;
...
@@ -212,13 +212,13 @@ bash chat.sh
...
@@ -212,13 +212,13 @@ bash chat.sh
1.
安装
`llama-recipes`
、
`lm-eval`
库
1.
安装
`llama-recipes`
、
`lm-eval`
库
```
bash
```
bash
# llama-recipes 下载
# llama-recipes 下载
git clone http://developer.
hpccube.com
/codes/chenych/llama-recipes.git
git clone http://developer.
sourcefind.cn
/codes/chenych/llama-recipes.git
cd
llama-recipes
cd
llama-recipes
# 移动exact_match.py文件
# 移动exact_match.py文件
mv
exact_match.py ~/.cache/huggingface/evaluate/downloads/
mv
exact_match.py ~/.cache/huggingface/evaluate/downloads/
cd
../
cd
../
# lm-eval 下载
# lm-eval 下载
git clone http://developer.
hpccube.com
/codes/chenych/lm-evaluation-harness.git
git clone http://developer.
sourcefind.cn
/codes/chenych/lm-evaluation-harness.git
cd
./lm-evaluation-harness/
cd
./lm-evaluation-harness/
pip
install
-e
.
pip
install
-e
.
```
```
...
@@ -355,7 +355,7 @@ python eval.py --model hf --model_args pretrained=/home/llama3/Meta-Llama-3-8B-I
...
@@ -355,7 +355,7 @@ python eval.py --model hf --model_args pretrained=/home/llama3/Meta-Llama-3-8B-I
```
```
## 源码仓库及问题反馈
## 源码仓库及问题反馈
-
https://developer.
hpccube.com
/codes/modelzoo/llama3_pytorch
-
https://developer.
sourcefind.cn
/codes/modelzoo/llama3_pytorch
## 参考资料
## 参考资料
-
https://github.com/meta-llama/llama3
-
https://github.com/meta-llama/llama3
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment