README_HIP.md 1.74 KB
Newer Older
quyuanhao123's avatar
quyuanhao123 committed
1
2
**编译安装步骤**

quyuanhao123's avatar
quyuanhao123 committed
3
- 1. 安装和选用dtk版本对应的pytorch torchvision whl(可在光合社区下载https://developer.hpccube.com/tool/)
quyuanhao123's avatar
quyuanhao123 committed
4
    例如:
quyuanhao123's avatar
quyuanhao123 committed
5
  
quyuanhao123's avatar
quyuanhao123 committed
6
    pip install https://cancon.hpccube.com:65024/directlink/4/pytorch/dtk22.10/torch-1.10.0a0+git2040069.dtk2210-cp38-cp38-manylinux2014_x86_64.whl
quyuanhao123's avatar
quyuanhao123 committed
7
  
quyuanhao123's avatar
quyuanhao123 committed
8
9
    pip install https://cancon.hpccube.com:65024/directlink/4/vision/dtk22.10/torchvision-0.10.0a0+e04d001.dtk2210-cp38-cp38-manylinux2014_x86_64.whl
    pip install -r requirements.txt
quyuanhao123's avatar
quyuanhao123 committed
10

quyuanhao123's avatar
quyuanhao123 committed
11
12
- 2. 添加编译时的conda环境及部分库的环境变量
    激活对应的conda环境:
quyuanhao123's avatar
quyuanhao123 committed
13

quyuanhao123's avatar
quyuanhao123 committed
14
    source ~/miniconda3/etc/profile.d/conda.sh
quyuanhao123's avatar
quyuanhao123 committed
15

quyuanhao123's avatar
quyuanhao123 committed
16
    conda activate torch1.10_py39_dtk22.10
quyuanhao123's avatar
quyuanhao123 committed
17

quyuanhao123's avatar
quyuanhao123 committed
18
    加载对应的module,包括dtk:
quyuanhao123's avatar
quyuanhao123 committed
19

quyuanhao123's avatar
quyuanhao123 committed
20
    module purge
quyuanhao123's avatar
quyuanhao123 committed
21

quyuanhao123's avatar
quyuanhao123 committed
22
    module load compiler/devtoolset/7.3.1 mpi/hpcx/gcc-7.3.1 compiler/dtk/22.10.1
quyuanhao123's avatar
quyuanhao123 committed
23

quyuanhao123's avatar
quyuanhao123 committed
24
    module list
quyuanhao123's avatar
quyuanhao123 committed
25

quyuanhao123's avatar
quyuanhao123 committed
26
    加载所需的依赖库的环境变量(根据各集群实际路径调整):
quyuanhao123's avatar
quyuanhao123 committed
27

quyuanhao123's avatar
quyuanhao123 committed
28
    export C_INCLUDE_PATH=/public/software/apps/DeepLearning/PyTorch_Lib/gflags-2.1.2-build/include:$C_INCLUDE_PATH
quyuanhao123's avatar
quyuanhao123 committed
29

quyuanhao123's avatar
quyuanhao123 committed
30
    export CPLUS_INCLUDE_PATH=/public/software/apps/DeepLearning/PyTorch_Lib/gflags-2.1.2-build/include:$CPLUS_INCLUDE_PATH
quyuanhao123's avatar
quyuanhao123 committed
31

quyuanhao123's avatar
quyuanhao123 committed
32
    export C_INCLUDE_PATH=/public/software/apps/DeepLearning/PyTorch_Lib/glog-build/include:$C_INCLUDE_PATH
quyuanhao123's avatar
quyuanhao123 committed
33

quyuanhao123's avatar
quyuanhao123 committed
34
    export CPLUS_INCLUDE_PATH=/public/software/apps/DeepLearning/PyTorch_Lib/glog-build/include:$CPLUS_INCLUDE_PATH
quyuanhao123's avatar
quyuanhao123 committed
35

quyuanhao123's avatar
quyuanhao123 committed
36
    export C_INCLUDE_PATH=$ROCM_PATH/rocrand/include:$C_INCLUDE_PATH
quyuanhao123's avatar
quyuanhao123 committed
37

quyuanhao123's avatar
quyuanhao123 committed
38
    export CPLUS_INCLUDE_PATH=$ROCM_PATH/rocrand/include:$CPLUS_INCLUDE_PATH
quyuanhao123's avatar
quyuanhao123 committed
39

quyuanhao123's avatar
quyuanhao123 committed
40
    export LD_LIBRARY_PATH=$ROCM_PATH/rocrand/lib:$LD_LIBRARY_PATH
quyuanhao123's avatar
quyuanhao123 committed
41

quyuanhao123's avatar
quyuanhao123 committed
42
    修改编译器环境变量:
quyuanhao123's avatar
quyuanhao123 committed
43
  
quyuanhao123's avatar
quyuanhao123 committed
44
    export FORCE_ONLY_HIP=1
quyuanhao123's avatar
quyuanhao123 committed
45

quyuanhao123's avatar
quyuanhao123 committed
46
    export CC=hipcc
quyuanhao123's avatar
quyuanhao123 committed
47

quyuanhao123's avatar
quyuanhao123 committed
48
    export CXX=hipcc
quyuanhao123's avatar
quyuanhao123 committed
49

quyuanhao123's avatar
quyuanhao123 committed
50
- 3. 编译安装
quyuanhao123's avatar
quyuanhao123 committed
51
  
quyuanhao123's avatar
quyuanhao123 committed
52
    python setup.py install