Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Qwen2_pytorch
Commits
aa290544
Commit
aa290544
authored
Sep 21, 2024
by
luopl
Browse files
Update README.md
parent
4fe69b89
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
13 additions
and
9 deletions
+13
-9
README.md
README.md
+13
-9
No files found.
README.md
View file @
aa290544
...
@@ -82,20 +82,13 @@ pip install e . -i https://mirrors.aliyun.com/pypi/simple/ --trusted-host mirro
...
@@ -82,20 +82,13 @@ pip install e . -i https://mirrors.aliyun.com/pypi/simple/ --trusted-host mirro
## 训练
## 训练
使用LLaMA-Factory框架微调
使用LLaMA-Factory框架微调
### 模型下载
[
qwen2-7B模型下载SCNet链接
](
http://113.200.138.88:18080/aimodels/Qwen2-7B
)
[
qwen2-7B-Instruct模型下载SCNet链接
](
http://113.200.138.88:18080/aimodels/Qwen2-7B-Instruct
)
[
qwen2-72B模型下载SCNet链接
](
http://113.200.138.88:18080/aimodels/Qwen2-72B
)
[
qwen2-72B-Instruct模型下载SCNet链接
](
http://113.200.138.88:18080/aimodels/Qwen2-72B-Instruct
)
### 单机单卡(LoRA-finetune)
### 单机单卡(LoRA-finetune)
```
```
#注意:根据自己的模型切换.yaml文件中的模型位置并调整其他参数
#注意:根据自己的模型切换.yaml文件中的模型位置并调整其他参数
cd /path/your_code_data/
cd /path/your_code_data/
cd LLaMA-Factory
cd LLaMA-Factory
export FORCE_TORCHRUN=1
HIP_VISIBLE_DEVICES=0 llamafactory-cli train examples/train_lora/qwen2_lora_sft_ds3.yaml
HIP_VISIBLE_DEVICES=0 llamafactory-cli train examples/train_lora/qwen2_lora_sft_ds3.yaml
```
```
...
@@ -149,8 +142,19 @@ python ./inference_vllm/Qwen2_72B_inference.py
...
@@ -149,8 +142,19 @@ python ./inference_vllm/Qwen2_72B_inference.py
`对话问答`
`对话问答`
### 热点应用行业
### 热点应用行业
`科研,教育,政府,金融`
`科研,教育,政府,金融`
## 预训练权重
[
qwen2-7B模型下载SCNet链接
](
http://113.200.138.88:18080/aimodels/Qwen2-7B
)
[
qwen2-7B-Instruct模型下载SCNet链接
](
http://113.200.138.88:18080/aimodels/Qwen2-7B-Instruct
)
[
qwen2-72B模型下载SCNet链接
](
http://113.200.138.88:18080/aimodels/Qwen2-72B
)
[
qwen2-72B-Instruct模型下载SCNet链接
](
http://113.200.138.88:18080/aimodels/Qwen2-72B-Instruct
)
## 源码仓库及问题反馈
## 源码仓库及问题反馈
-
http://developer.hpccube.com/codes/modelzoo/qwen
1.5-
pytorch
.git
-
http
s
://developer.hpccube.com/codes/modelzoo/qwen
2_
pytorch
## 参考资料
## 参考资料
-
https://github.com/hiyouga/LLaMA-Factory
-
https://github.com/hiyouga/LLaMA-Factory
-
https://github.com/QwenLM/Qwen2
-
https://github.com/QwenLM/Qwen2
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment