Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Deepseek_Math_7b_pytorch
Commits
a85d578d
You need to sign in or sign up before continuing.
Commit
a85d578d
authored
Jul 04, 2024
by
zhougaofeng
Browse files
Update README.md
parent
d42063c1
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
3 deletions
+2
-3
README.md
README.md
+2
-3
No files found.
README.md
View file @
a85d578d
...
@@ -28,7 +28,7 @@ DeepSeekMath在DeepSeek-Coder-Base-v1.5-7B的基础上进行预训练,使用了
...
@@ -28,7 +28,7 @@ DeepSeekMath在DeepSeek-Coder-Base-v1.5-7B的基础上进行预训练,使用了
此处提供
[
光源
](
https://www.sourcefind.cn/#/service-details
)
拉取 docker 镜像的地址与使用步骤
此处提供
[
光源
](
https://www.sourcefind.cn/#/service-details
)
拉取 docker 镜像的地址与使用步骤
```
```
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-centos7.6-dtk2
4.04
-py310
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-centos7.6-dtk2
3.10.1
-py310
docker run -it --shm-size=1024G -v <Host Path>:<Container Path> -v /opt/hyhal:/opt/hyhal --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name deepseek-math <your IMAGE ID> bash # <your IMAGE ID>为以上拉取的docker的镜像ID替换,本镜像为:c85ed27005f2
docker run -it --shm-size=1024G -v <Host Path>:<Container Path> -v /opt/hyhal:/opt/hyhal --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name deepseek-math <your IMAGE ID> bash # <your IMAGE ID>为以上拉取的docker的镜像ID替换,本镜像为:c85ed27005f2
cd /home/deepseek-math-pytorch
cd /home/deepseek-math-pytorch
pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
...
@@ -114,7 +114,6 @@ python 7B_single_node.py
...
@@ -114,7 +114,6 @@ python 7B_single_node.py
使用的加速卡:2张 DCU-K100-64G
使用的加速卡:2张 DCU-K100-64G
<div
align=
center
>
<div
align=
center
>
<img
src=
"./doc/inference.png"
/>
<img
src=
"./doc/result.png"
/>
<img
src=
"./doc/result.png"
/>
</div>
</div>
...
@@ -124,7 +123,7 @@ python 7B_single_node.py
...
@@ -124,7 +123,7 @@ python 7B_single_node.py
根据测试结果情况填写表格:
根据测试结果情况填写表格:
| device | train_loss |
| device | train_loss |
| :------: | :------: |
| :------: | :------: |
| DCU-K100 | 1.041
5
|
| DCU-K100 | 1.041
7
|
| GPU-A800 | 1.0419 |
| GPU-A800 | 1.0419 |
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment