Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Lmdeploy
Commits
4b5c2bda
Unverified
Commit
4b5c2bda
authored
Sep 05, 2023
by
pppppM
Committed by
GitHub
Sep 05, 2023
Browse files
[Docs] Simplify `build.md` (#370)
* use conda install nccl, openmpi and rapidjson * update en doc
parent
683c3fe9
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
20 additions
and
30 deletions
+20
-30
docs/en/build.md
docs/en/build.md
+10
-15
docs/zh_cn/build.md
docs/zh_cn/build.md
+10
-15
No files found.
docs/en/build.md
View file @
4b5c2bda
## Build from source
## Build from source
-
make sure local gcc version no less than 9, which can be conformed by
`gcc --version`
.
-
install packages for compiling and running:
-
install packages for compiling and running:
```
shell
```
shell
conda create
-n
lmdeploy
python
=
3.10
conda activate lmdeploy
git clone https://github.com/InternLM/lmdeploy.git
cd
lmdeploy
pip
install
-r
requirements.txt
pip
install
-r
requirements.txt
conda
install
openmpi-mpicxx nccl rapidjson
-c
conda-forge
```
```
-
install
[
nccl
](
https://docs.nvidia.com/deeplearning/nccl/install-guide/index.html
)
, set environment variables:
```
shell
export
NCCL_ROOT_DIR
=
/path/to/nccl/build
export
NCCL_LIBRARIES
=
/path/to/nccl/build/lib
```
-
install rapidjson
-
install openmpi, installing from source is recommended.
```
shell
wget https://download.open-mpi.org/release/open-mpi/v4.1/openmpi-4.1.5.tar.gz
tar
-xzf
openmpi-
*
.tar.gz
&&
cd
openmpi-
*
./configure
--with-cuda
make
-j
$(
nproc
)
make
install
```
-
build and install lmdeploy:
-
build and install lmdeploy:
```
shell
```
shell
mkdir
build
&&
cd
build
mkdir
build
&&
cd
build
sh ../generate.sh
sh ../generate.sh
...
...
docs/zh_cn/build.md
View file @
4b5c2bda
### 源码安装
### 源码安装
-
确保物理机环境的 gcc 版本不低于 9,可以通过
`gcc --version`
确认。
-
安装编译和运行依赖包:
-
安装编译和运行依赖包:
```
shell
```
shell
conda create
-n
lmdeploy
python
=
3.10
conda activate lmdeploy
git clone https://github.com/InternLM/lmdeploy.git
cd
lmdeploy
pip
install
-r
requirements.txt
pip
install
-r
requirements.txt
conda
install
openmpi-mpicxx nccl rapidjson
-c
conda-forge
```
```
-
安装
[
nccl
](
https://docs.nvidia.com/deeplearning/nccl/install-guide/index.html
)
,设置环境变量
```
shell
export
NCCL_ROOT_DIR
=
/path/to/nccl/build
export
NCCL_LIBRARIES
=
/path/to/nccl/build/lib
```
-
rapidjson 安装
-
openmpi 安装, 推荐从源码安装:
```
shell
wget https://download.open-mpi.org/release/open-mpi/v4.1/openmpi-4.1.5.tar.gz
tar
-xzf
openmpi-
*
.tar.gz
&&
cd
openmpi-
*
./configure
--with-cuda
make
-j
$(
nproc
)
make
install
```
-
lmdeploy 编译安装:
-
lmdeploy 编译安装:
```
shell
```
shell
mkdir
build
&&
cd
build
mkdir
build
&&
cd
build
sh ../generate.sh
sh ../generate.sh
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment