Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
ModelZoo
Yi_lmdeploy
Commits
fd488816
Commit
fd488816
authored
Aug 23, 2024
by
xuxzh1
🎱
Browse files
update readme
parent
61514657
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
27 additions
and
4 deletions
+27
-4
README.md
README.md
+27
-4
No files found.
README.md
View file @
fd488816
...
@@ -17,19 +17,42 @@ Yi 系列模型以双语语言模型为目标,并在 3T 多语言语料库上
...
@@ -17,19 +17,42 @@ Yi 系列模型以双语语言模型为目标,并在 3T 多语言语料库上
## 环境配置
## 环境配置
提供光源拉取推理的docker镜像:
提供光源拉取推理的docker镜像:
```
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:lmdeploy-dtk23.10-torch1.13-py38
```
bash
docker pull image.sourcefind.cn:5000/dcu/admin/base/pytorch:2.1.0-ubuntu20.04-dtk24.04.1-py3.10
(
推荐
)
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:lmdeploy0.0.13_dtk23.04_torch1.13_py38
# <Image ID>用上面拉取docker镜像的ID替换
# <Host Path>主机端路径
# <Host Path>主机端路径
# <Container Path>容器映射路径
# <Container Path>容器映射路径
docker run -it --name
codellama
--shm-size=1024G
-v /opt/hyhal:/opt/hyhal
--device=/dev/kfd --device=/dev/dri/ --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --ulimit memlock=-1:-1 --ipc=host --network host --group-add video -v <Host Path>:<Container Path>
i
mage
.sourcefind.cn:5000/dcu/admin/base/custom:lmdeploy-dtk23.10-torch1.13-py38
/bin/bash
docker run
-it
--name
baichuan
--shm-size
=
1024G
--device
=
/dev/kfd
--device
=
/dev/dri/
--cap-add
=
SYS_PTRACE
--security-opt
seccomp
=
unconfined
--ulimit
memlock
=
-1
:-1
--ipc
=
host
--network
host
--group-add
video
-v
<Host Path>:<Container Path>
<I
mage
ID>
/bin/bash
```
```
镜像版本依赖:
*
DTK驱动:24.04.1
*
Pytorch: 2.1.0
*
python: python3.10
> [!NOTE]
>
> 使用lmdeploy0.0.13_dtk23.04_torch1.13_py38如果遇到 importError:libgemm multiB int4.so: cannot open shared obiect file: No such file or directory
>
> 解决方法:
>
> ```bash
> rm /usr/local/lib/python3.8/site-packages/_turbomind.cpython-38-x86_64-linux-gnu.so
> ```
## 数据集
## 数据集
无
无
## 推理
## 推理
### 源码编译安装
### 源码编译安装
```
```
bash
git clone http://developer.hpccube.com/codes/modelzoo/yi_lmdeploy.git
git clone http://developer.hpccube.com/codes/modelzoo/yi_lmdeploy.git
cd
yi_lmdeploy
cd
yi_lmdeploy
git submodule init
&&
git submodule update
git submodule init
&&
git submodule update
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment