README.md 1.84 KB
Newer Older
quyuanhao123's avatar
quyuanhao123 committed
1

quyuanhao123's avatar
quyuanhao123 committed
2
3
4
**编译安装步骤**


quyuanhao123's avatar
quyuanhao123 committed
5
6
7
8
9
10
11
12
13
14
15
16
17
18
- 1. 安装与dtk版本对应的pytorch torchvision whl(可在光合社区下载https://developer.hpccube.com/tool/)以及其他依赖库
    

    例如:
  
    pip install https://cancon.hpccube.com:65024/directlink/4/pytorch/dtk22.10/torch-1.10.0a0+git2040069.dtk2210-cp38-cp38-manylinux2014_x86_64.whl
  
    pip install https://cancon.hpccube.com:65024/directlink/4/vision/dtk22.10/torchvision-0.10.0a0+e04d001.dtk2210-cp38-cp38-manylinux2014_x86_64.whl
    
    pip install -r requirements.txt

- 2. 添加编译时的conda环境及部分库的环境变量
    
    - 2.1 激活对应的conda环境:
quyuanhao123's avatar
quyuanhao123 committed
19

quyuanhao123's avatar
quyuanhao123 committed
20
21
 
      source ~/miniconda3/etc/profile.d/conda.sh
quyuanhao123's avatar
quyuanhao123 committed
22

quyuanhao123's avatar
quyuanhao123 committed
23
      conda activate torch1.10_py39_dtk22.10
quyuanhao123's avatar
quyuanhao123 committed
24

quyuanhao123's avatar
quyuanhao123 committed
25
    - 2.2 加载对应的module,包括dtk:
quyuanhao123's avatar
quyuanhao123 committed
26

quyuanhao123's avatar
quyuanhao123 committed
27
28
 
      module purge
quyuanhao123's avatar
quyuanhao123 committed
29

quyuanhao123's avatar
quyuanhao123 committed
30
      module load compiler/devtoolset/7.3.1 mpi/hpcx/gcc-7.3.1 compiler/dtk/22.10.1
quyuanhao123's avatar
quyuanhao123 committed
31

quyuanhao123's avatar
quyuanhao123 committed
32
      module list
quyuanhao123's avatar
quyuanhao123 committed
33

quyuanhao123's avatar
quyuanhao123 committed
34
    - 2.3 加载所需的依赖库的环境变量(根据各集群实际路径调整):
quyuanhao123's avatar
quyuanhao123 committed
35

quyuanhao123's avatar
quyuanhao123 committed
36
37
 
      export C_INCLUDE_PATH=/public/software/apps/DeepLearning/PyTorch_Lib/gflags-2.1.2-build/include:$C_INCLUDE_PATH
quyuanhao123's avatar
quyuanhao123 committed
38

quyuanhao123's avatar
quyuanhao123 committed
39
      export CPLUS_INCLUDE_PATH=/public/software/apps/DeepLearning/PyTorch_Lib/gflags-2.1.2-build/include:$CPLUS_INCLUDE_PATH
quyuanhao123's avatar
quyuanhao123 committed
40

quyuanhao123's avatar
quyuanhao123 committed
41
      export C_INCLUDE_PATH=/public/software/apps/DeepLearning/PyTorch_Lib/glog-build/include:$C_INCLUDE_PATH
quyuanhao123's avatar
quyuanhao123 committed
42

quyuanhao123's avatar
quyuanhao123 committed
43
      export CPLUS_INCLUDE_PATH=/public/software/apps/DeepLearning/PyTorch_Lib/glog-build/include:$CPLUS_INCLUDE_PATH
quyuanhao123's avatar
quyuanhao123 committed
44

quyuanhao123's avatar
quyuanhao123 committed
45
      export C_INCLUDE_PATH=$ROCM_PATH/rocrand/include:$C_INCLUDE_PATH
quyuanhao123's avatar
quyuanhao123 committed
46

quyuanhao123's avatar
quyuanhao123 committed
47
      export CPLUS_INCLUDE_PATH=$ROCM_PATH/rocrand/include:$CPLUS_INCLUDE_PATH
quyuanhao123's avatar
quyuanhao123 committed
48

quyuanhao123's avatar
quyuanhao123 committed
49
      export LD_LIBRARY_PATH=$ROCM_PATH/rocrand/lib:$LD_LIBRARY_PATH
quyuanhao123's avatar
quyuanhao123 committed
50

quyuanhao123's avatar
quyuanhao123 committed
51
    - 2.4 修改编译器环境变量:
quyuanhao123's avatar
quyuanhao123 committed
52
53
  

quyuanhao123's avatar
quyuanhao123 committed
54
      export FORCE_ONLY_HIP=1
quyuanhao123's avatar
quyuanhao123 committed
55

quyuanhao123's avatar
quyuanhao123 committed
56
      export CC=hipcc
quyuanhao123's avatar
quyuanhao123 committed
57

quyuanhao123's avatar
quyuanhao123 committed
58
      export CXX=hipcc
quyuanhao123's avatar
quyuanhao123 committed
59

quyuanhao123's avatar
quyuanhao123 committed
60
- 3. 编译安装
quyuanhao123's avatar
quyuanhao123 committed
61
  
quyuanhao123's avatar
quyuanhao123 committed
62
63

      python setup.py install