Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
DeepSeekV2_pytorch
Commits
0593083e
"...git@developer.sourcefind.cn:chenpangpang/open-webui.git" did not exist on "cd92cf0da5302bf3bc7694866e76b811f35b1ab0"
Commit
0593083e
authored
Oct 22, 2024
by
dcuai
Browse files
Update README.md
parent
9e5d9724
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
13 additions
and
4 deletions
+13
-4
README.md
README.md
+13
-4
No files found.
README.md
View file @
0593083e
...
@@ -66,9 +66,9 @@ pip install -r requirements.txt
...
@@ -66,9 +66,9 @@ pip install -r requirements.txt
│ └── mmap_deepseekv2_datasets_text_document.idx
│ └── mmap_deepseekv2_datasets_text_document.idx
```
```
## 预训练模型下载
## 预训练模型下载
ModelScope
模型下载地址:
模型下载地址:
[
DeepSeek-V2-
Lite-
Chat
](
http
s
://
www.modelscope.cn/models/deepseek-ai
/DeepSeek-V2-
Lite-
Chat
)
[
DeepSeek-V2-Chat
](
http://
113.200.138.88:18080/aimodels
/DeepSeek-V2-Chat
)
[
DeepSeek-V2-Chat
](
http
s
://
www.modelscope.cn/models/deepseek-ai
/DeepSeek-V2-Chat
)
[
DeepSeek-V2-
Lite-
Chat
](
http://
113.200.138.88:18080/aimodels
/DeepSeek-V2-
Lite-
Chat
)
## 模型格式转换
## 模型格式转换
若您需要进行模型的从头预训练,则可以跳过该步骤;若您想进行模型的继续预训练,则需要进行模型格式的转换,MoE模型的格式转换命令如下,其中模型切分方式可以根据需求自行修改:
若您需要进行模型的从头预训练,则可以跳过该步骤;若您想进行模型的继续预训练,则需要进行模型格式的转换,MoE模型的格式转换命令如下,其中模型切分方式可以根据需求自行修改:
...
@@ -97,11 +97,20 @@ cd ./examples/deepseek_v2/
...
@@ -97,11 +97,20 @@ cd ./examples/deepseek_v2/
chmod u+x run_pretrain_deepseek_xx.sh
chmod u+x run_pretrain_deepseek_xx.sh
mpirun -np 16 --hostfile 2node --allow-run-as-root -mca plm_rsh_args "-p 2727" --bind-to none run_pretrain_deepseek_16B.sh node90
mpirun -np 16 --hostfile 2node --allow-run-as-root -mca plm_rsh_args "-p 2727" --bind-to none run_pretrain_deepseek_16B.sh node90
```
```
## 推理
相关模型推理可参考此模型:(https://developer.sourcefind.cn/codes/modelzoo/deepseek-v2_pytorch)
## result
</div>
<img
src=
"./doc/chat_completion.png"
width=
"500"
height=
"300"
/>
</div>
## 应用场景
## 应用场景
### 算法类别
### 算法类别
`
自然语言处理
`
`
对话问答
`
### 热点应用行业
### 热点应用行业
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment