Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Yi-1.5-6B-chat_pytorch
Commits
34e1e7ba
Commit
34e1e7ba
authored
Nov 12, 2024
by
dcuai
Browse files
Update README.md ——dtk24.04.3
parent
74ee9e29
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
7 deletions
+8
-7
README.md
README.md
+8
-7
No files found.
README.md
View file @
34e1e7ba
...
@@ -20,12 +20,12 @@ Yi-1.5是一个 decoder-only 的 transformer 模型,使用 SwiGLU激活函数
...
@@ -20,12 +20,12 @@ Yi-1.5是一个 decoder-only 的 transformer 模型,使用 SwiGLU激活函数
此处提供
[
光源
](
https://www.sourcefind.cn/#/service-details
)
拉取 docker 镜像的地址与使用步骤
此处提供
[
光源
](
https://www.sourcefind.cn/#/service-details
)
拉取 docker 镜像的地址与使用步骤
```
```
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-
centos7.6-dtk24.04-py310
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-
py3.10-dtk24.04.3-ubuntu20.04
docker run -it --shm-size=1024G -v <Host Path>:<Container Path> -v /opt/hyhal:/opt/hyhal --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name Yi-1.5 <your IMAGE ID> bash # <your IMAGE ID>为以上拉取的docker的镜像ID替换
,本镜像为:c85ed27005f2
docker run -it --shm-size=1024G -v <Host Path>:<Container Path> -v /opt/hyhal:/opt/hyhal --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name Yi-1.5 <your IMAGE ID> bash # <your IMAGE ID>为以上拉取的docker的镜像ID替换
cd /home/Yi-1.5-pytorch
cd /home/Yi-1.5-pytorch
pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
# bitsandbytes可从whl.zip文件里获取安装:
pip install
bitsandbytes-0.42.0-py3-none-any.whl
pip
un
install
vllm
```
```
...
@@ -37,8 +37,8 @@ pip install bitsandbytes-0.42.0-py3-none-any.whl
...
@@ -37,8 +37,8 @@ pip install bitsandbytes-0.42.0-py3-none-any.whl
docker build -t yi-1.5-df:latest .
docker build -t yi-1.5-df:latest .
docker run -it --shm-size=1024G -v <Host Path>:<Container Path> -v /opt/hyhal:/opt/hyhal --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name yi-1.5 yi-1.5-df bash
docker run -it --shm-size=1024G -v <Host Path>:<Container Path> -v /opt/hyhal:/opt/hyhal --privileged=true --device=/dev/kfd --device=/dev/dri/ --group-add video --name yi-1.5 yi-1.5-df bash
pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
pip install -r requirements.txt -i https://mirrors.aliyun.com/pypi/simple/ --trusted-host mirrors.aliyun.com
# bitsandbytes可从whl.zip文件里获取安装:
pip install
bitsandbytes-0.42.0-py3-none-any.whl
pip
un
install
vllm
```
```
...
@@ -49,7 +49,7 @@ pip install bitsandbytes-0.42.0-py3-none-any.whl
...
@@ -49,7 +49,7 @@ pip install bitsandbytes-0.42.0-py3-none-any.whl
关于本项目 DCU 显卡所需的特殊深度学习库可从
[
光合
](
https://developer.hpccube.com/tool/
)
开发者社区下载安装。
关于本项目 DCU 显卡所需的特殊深度学习库可从
[
光合
](
https://developer.hpccube.com/tool/
)
开发者社区下载安装。
```
```
DTK驱动:dtk24.04
DTK驱动:dtk24.04
.3
python:python3.10
python:python3.10
torch: 2.1.0
torch: 2.1.0
torchvision: 0.16.0
torchvision: 0.16.0
...
@@ -130,6 +130,7 @@ sh 6B_single_dcu.sh
...
@@ -130,6 +130,7 @@ sh 6B_single_dcu.sh
| GPU-A800 | 0.7651 |
| GPU-A800 | 0.7651 |
## 应用场景
### 算法类别
### 算法类别
对话问答
对话问答
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment