Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
LLaMA_TencentPretrain_pytorch
Commits
e187d8b6
Commit
e187d8b6
authored
Aug 05, 2024
by
wanglch
Browse files
Update README.md
parent
e136b88e
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
9 additions
and
1 deletion
+9
-1
README.md
README.md
+9
-1
No files found.
README.md
View file @
e187d8b6
...
@@ -95,7 +95,7 @@ $ tree ./data/
...
@@ -95,7 +95,7 @@ $ tree ./data/
```
```
### 模型权重下载
### 模型权重下载
1.
方式一:下载huggingface格式模型。以 7B 模型为例,首先下载预训练
[
LLaMA权重
](
http
s
://
huggingface.co/decapoda-research
/llama-7b-hf
)
,转换到TencentPretrain格式:
1.
方式一:下载huggingface格式模型。以 7B 模型为例,首先下载预训练
[
llama-7b-hf
](
http://
113.200.138.88:18080/aimodels
/llama-7b-hf
)
,转换到TencentPretrain格式:
```
commandline
```
commandline
python3 scripts/convert_llama_from_huggingface_to_tencentpretrain.py --input_model_path $LLaMA_HF_PATH \
python3 scripts/convert_llama_from_huggingface_to_tencentpretrain.py --input_model_path $LLaMA_HF_PATH \
--output_model_path models/llama-7b.bin --type 7B
--output_model_path models/llama-7b.bin --type 7B
...
@@ -235,6 +235,14 @@ TencentPretrain格式模型推理请参考[llama_inference_pytorch](https://deve
...
@@ -235,6 +235,14 @@ TencentPretrain格式模型推理请参考[llama_inference_pytorch](https://deve
`医疗,教育,科研,金融`
`医疗,教育,科研,金融`
## 预训练权重
预训练权重快速下载中心:
[
SCNet AIModels
](
http://113.200.138.88:18080/aimodels
)
项目中的预训练权重可从快速下载通道下载:
[
llama-7b-hf
](
http://113.200.138.88:18080/aimodels/llama-7b-hf
)
## 源码仓库及问题反馈
## 源码仓库及问题反馈
-
https://developer.hpccube.com/codes/modelzoo/llama_tencentpretrain_pytorch
-
https://developer.hpccube.com/codes/modelzoo/llama_tencentpretrain_pytorch
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment