README.md 1.57 KB
Newer Older
JR_ZZU's avatar
JR_ZZU committed
1
2
# APEX

fengzch-das's avatar
fengzch-das committed
3
4
# 1 简介
DAS软件栈提供DCU适配版的apex深度学习框架。得益于DAS软件栈对apex特性功能的支持,开发者针对DCU加速卡开发应用时,可以便捷调用apex用于简化Pytorch中的混合精度和分布式训练等功能。
JR_ZZU's avatar
JR_ZZU committed
5

fengzch-das's avatar
fengzch-das committed
6
# 2 编译安装方式
JR_ZZU's avatar
JR_ZZU committed
7

fengzch-das's avatar
fengzch-das committed
8
## 2.1 环境准备
JR_ZZU's avatar
JR_ZZU committed
9

fengzch-das's avatar
fengzch-das committed
10
当前组件在下面的环境下已验证编译成功:
JR_ZZU's avatar
JR_ZZU committed
11

fengzch-das's avatar
fengzch-das committed
12
13
14
15
16
17
| 序号 | FastPT版本 | Pytorch版本 | DTK版本 |
| :--: | :--------: | :---------: | :-----: |
|  1  | 2.1.0+das.dtk25041 |2.5.1|dtk25041|
|  2  | 2.1.0+das.dtk2504 |2.5.1|dtk2504|
|  3  | 2.0.1+das.dtk25041 |2.4.1|dtk25041|
|  4  | 2.0.1+das.dtk2504 |2.4.1|dtk2504|
JR_ZZU's avatar
JR_ZZU committed
18

fengzch-das's avatar
fengzch-das committed
19
## 2.2 编译流程
JR_ZZU's avatar
JR_ZZU committed
20

fengzch-das's avatar
fengzch-das committed
21
### 2.2.1 基础环境检查
JR_ZZU's avatar
JR_ZZU committed
22

fengzch-das's avatar
fengzch-das committed
23
24
25
* 检查当前环境是否安装 DTK,若没有则需要安装 DTK,并确定当前环境下 DTK 的版本;
* 检查当前环境是否安装 Pytorch,若没有则需要安装 Pytorch,并确定当前环境下 Pytorch 的版本是否与 DTK 版本对应;
* 检查当前环境是否安装 FastPT,若没有则需要安装 FastPT,并确定当前环境下 FastPT 的版本是否与 Pytorch 的版本相对应。
JR_ZZU's avatar
JR_ZZU committed
26

fengzch-das's avatar
fengzch-das committed
27
28
29
30
31
### 2.2.2 apex 编译流程
* 安装依赖
```bash
pip install wheel
pip install pytest
JR_ZZU's avatar
JR_ZZU committed
32

fengzch-das's avatar
fengzch-das committed
33
source /usr/local/bin/fastpt -C
JR_ZZU's avatar
JR_ZZU committed
34

fengzch-das's avatar
fengzch-das committed
35
python3 setup.py --cpp_ext --cuda_ext --peer_memory --nccl_p2p --fast_bottleneck bdist_wheel # 编译指令
limm's avatar
limm committed
36
```
fengzch-das's avatar
fengzch-das committed
37
38
39
40
41
42
43
44
并通过下面的命令安装 Pytorch3d:
```bash
pip install dist/apex-0.1-cp310-cp310-linux_x86_64.whl
```
# 3  组件测试
执行下面的命令测试组件:
```bash
pip install expecttest
JR_ZZU's avatar
JR_ZZU committed
45

fengzch-das's avatar
fengzch-das committed
46
source /usr/local/bin/fastpt -E
limm's avatar
limm committed
47

fengzch-das's avatar
fengzch-das committed
48
49
cd tests/L0
python run_test.py
limm's avatar
limm committed
50
```