Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Baichuan_pytorch
Commits
aa57c446
Commit
aa57c446
authored
Aug 30, 2024
by
dcuai
Browse files
Update README.md
parent
4b1068ba
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
7 additions
and
7 deletions
+7
-7
README.md
README.md
+7
-7
No files found.
README.md
View file @
aa57c446
...
...
@@ -29,8 +29,8 @@ Baichuan整体模型基于标准的Transformer结构,采用了和LLaMA一样
### Docker(方式一)
推荐使用docker方式运行,提供拉取的docker镜像:
```
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:
1
.1
3.1-centos7.6
-dtk
-23
.04-py3
8-latest
docker run -dit --network=host --name=baichuan --privileged --device=/dev/kfd --device=/dev/dri --ipc=host --shm-size=16G --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -u root --ulimit stack=-1:-1 --ulimit memlock=-1:-1 image.sourcefind.cn:5000/dcu/admin/base/pytorch:1.13.1-centos7.6-dtk-23.04-py38-latest /bin/bash
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:
2
.1
.0-ubuntu20.04
-dtk
24
.04
.1
-py3
.10
docker run -dit --network=host --name=baichuan
-v /opt/hyhal:/opt/hyhal:ro
--privileged --device=/dev/kfd --device=/dev/dri --ipc=host --shm-size=16G --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -u root --ulimit stack=-1:-1 --ulimit memlock=-1:-1 image.sourcefind.cn:5000/dcu/admin/base/pytorch:1.13.1-centos7.6-dtk-23.04-py38-latest /bin/bash
docker exec -it baichuan /bin/bash
```
安装docker中没有的依赖:
...
...
@@ -42,20 +42,20 @@ pip install -r requirements.txt -i http://mirrors.aliyun.com/pypi/simple/ --tru
#### Dockerfile(方式二)
```
docker build -t baichuan:latest .
docker run -dit --network=host --name=baichuan --privileged --device=/dev/kfd --device=/dev/dri --ipc=host --shm-size=16G --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -u root --ulimit stack=-1:-1 --ulimit memlock=-1:-1 baichuan:latest
docker run -dit --network=host
-v /opt/hyhal:/opt/hyhal:ro
--name=baichuan --privileged --device=/dev/kfd --device=/dev/dri --ipc=host --shm-size=16G --group-add video --cap-add=SYS_PTRACE --security-opt seccomp=unconfined -u root --ulimit stack=-1:-1 --ulimit memlock=-1:-1 baichuan:latest
docker exec -it baichuan /bin/bash
```
### Conda(方式三)
1.
创建conda虚拟环境:
```
conda create -n chatglm python=3.
8
conda create -n chatglm python=3.
10
```
2.
关于本项目DCU显卡所需的工具包、深度学习库等均可从
[
光合
](
https://developer.hpccube.com/tool/
)
开发者社区下载安装。
-
[
DTK 2
3
.04
](
https://cancon.hpccube.com:65024/1/main/DTK-2
3
.04.1
)
-
[
Pytorch
1
.1
3.1
](
https://cancon.hpccube.com:65024/
4/main/pytorch/dtk23.04
)
-
[
Deepspeed 0.
9.2
](
https://cancon.hpccube.com:65024/
4/main/deepspeed/dtk23.04
)
-
[
DTK 2
4
.04
.1
](
https://cancon.hpccube.com:65024/1/main/DTK-2
4
.04.1
)
-
[
Pytorch
2
.1
.0
](
https://cancon.hpccube.com:65024/
directlink/4/pytorch/DAS1.1/torch-2.1.0+das1.1.git3ac1bdd.abi1.dtk2404-cp310-cp310-manylinux_2_31_x86_64.whl
)
-
[
Deepspeed 0.
12.3
](
https://cancon.hpccube.com:65024/
directlink/4/deepspeed/DAS1.1/deepspeed-0.12.3+gita724046.abi1.dtk2404.torch2.1.0-cp310-cp310-manylinux_2_31_x86_64.whl
)
Tips:以上dtk驱动、python、deepspeed等工具版本需要严格一一对应。
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment