Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Lmdeploy
Commits
cc20bea5
Commit
cc20bea5
authored
Dec 09, 2023
by
xiabo
Browse files
Update README.md
parent
f180aefb
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
8 deletions
+4
-8
README.md
README.md
+4
-8
No files found.
README.md
View file @
cc20bea5
...
@@ -32,7 +32,7 @@ LMdeploy官方github地址:[https://github.com/InternLM/lmdeploy](https://github
...
@@ -32,7 +32,7 @@ LMdeploy官方github地址:[https://github.com/InternLM/lmdeploy](https://github
#### 编译环境准备
#### 编译环境准备
下载光源的镜像,起dcoker
下载光源的镜像,起dcoker
```
```
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:lmdeploy
_
dtk2310
_
torch1.13
_
py38
docker pull image.sourcefind.cn:5000/dcu/admin/base/custom:lmdeploy
-
dtk23
.
10
-
torch1.13
-
py38
# <Image ID>用上面拉取docker镜像的ID替换
# <Image ID>用上面拉取docker镜像的ID替换
# <Host Path>主机端路径
# <Host Path>主机端路径
...
@@ -44,7 +44,7 @@ docker run -it --name baichuan --shm-size=1024G --device=/dev/kfd --device=/dev
...
@@ -44,7 +44,7 @@ docker run -it --name baichuan --shm-size=1024G --device=/dev/kfd --device=/dev
pip3 install -r requirements.txt
pip3 install -r requirements.txt
pip3 install urllib3==1.24
pip3 install urllib3==1.24
yum install rapidjson
yum install rapidjson
# gcc版本需要>=9 安装高版本gcc
# gcc版本需要>=9 安装高版本gcc
若使用gcc7的版本,下载gcc7版本的分支
yum install -y centos-release-scl
yum install -y centos-release-scl
yum install -y devtoolset-9
yum install -y devtoolset-9
scl enable devtoolset-9 bash
scl enable devtoolset-9 bash
...
@@ -52,16 +52,12 @@ scl enable devtoolset-9 bash
...
@@ -52,16 +52,12 @@ scl enable devtoolset-9 bash
# 执行dtk环境变量
# 执行dtk环境变量
source {DTK_PATH}/env.sh
source {DTK_PATH}/env.sh
source {DTK_PATH}/cuda/env.sh
source {DTK_PATH}/cuda/env.sh
export GPU_MAX_HW_QUEUES=4
export NCCL_LAUNCH_MODE=GROUP
export HIP_DIRECT_DISPATCH=0
export GPU_FLUSH_ON_EXECUTION=1
export AMD_SERIALIZE_KERNEL=1
export AMD_SERIALIZE_COPY=1
```
```
#### 源码编译安装
#### 源码编译安装
-
代码下载
-
代码下载
根据不同的需求下载不同的分支
根据不同的需求下载不同的分支
(光源镜像已经提供安装,可以直接使用。根据个人需求是否要重新编译)
-
提供2种源码编译方式(进入lmdeploy目录):
-
提供2种源码编译方式(进入lmdeploy目录):
```
```
1. 源码编译安装
1. 源码编译安装
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment