README.md 1.8 KB
Newer Older
zhuwenwen's avatar
zhuwenwen committed
1
2
# <div align="center"><strong>Colossal-AI</strong></div>
## 简介
zhuwenwen's avatar
zhuwenwen committed
3
Colossal-AI提供了一系列并行组件,主要提供以下功能:提供用户友好的工具,支持编写分布式深度学习模型,只需几行即可启动分布式训练和推理。
zhuwenwen's avatar
zhuwenwen committed
4

zhuwenwen's avatar
zhuwenwen committed
5
6
7
8
9
## 安装
Colossal-AI支持
+ Python 3.7.
+ Python 3.8.
+ Python 3.9.
zhuwenwen's avatar
zhuwenwen committed
10

zhuwenwen's avatar
zhuwenwen committed
11
### 使用源码编译方式安装
zhuwenwen's avatar
zhuwenwen committed
12

zhuwenwen's avatar
zhuwenwen committed
13
#### 编译环境准备
zhuwenwen's avatar
zhuwenwen committed
14
提供2种环境准备方式:
zhuwenwen's avatar
zhuwenwen committed
15

zhuwenwen's avatar
zhuwenwen committed
16
17
18
1. 基于光源pytorch基础镜像环境:镜像下载地址:[https://sourcefind.cn/#/image/dcu/pytorch](https://sourcefind.cn/#/image/dcu/pytorch),根据pytorch、python、dtk及系统下载对应的镜像版本。

2. 基于现有python环境:安装pytorch,pytorch whl包下载目录:[https://cancon.hpccube.com:65024/4/main/pytorch/dtk23.10](https://cancon.hpccube.com:65024/4/main/pytorch/dtk23.10),根据python、dtk版本,下载对应pytorch的whl包。安装命令如下:
zhuwenwen's avatar
zhuwenwen committed
19
```shell
zhuwenwen's avatar
zhuwenwen committed
20
pip install torch* (下载的torch的whl包)
zhuwenwen's avatar
zhuwenwen committed
21
pip install setuptools wheel
zhuwenwen's avatar
zhuwenwen committed
22
23
```

zhuwenwen's avatar
zhuwenwen committed
24
#### 源码编译安装
zhuwenwen's avatar
zhuwenwen committed
25
```shell
zhuwenwen's avatar
zhuwenwen committed
26
git clone https://developer.hpccube.com/codes/aicomponent/colossalai # 根据需要的分支进行切换
zhuwenwen's avatar
zhuwenwen committed
27
```
zhuwenwen's avatar
zhuwenwen committed
28

zhuwenwen's avatar
zhuwenwen committed
29
30
31
- 提供2种源码编译方式(进入colossalai目录):
```
1. 编译whl包并安装
zhuwenwen's avatar
zhuwenwen committed
32
33
python setup.py bdist_wheel 
pip install dist/colossalai*
zhuwenwen's avatar
zhuwenwen committed
34

zhuwenwen's avatar
zhuwenwen committed
35
36
2. 源码编译安装
python3 setup.py install 
zhuwenwen's avatar
zhuwenwen committed
37
38
```

zhuwenwen's avatar
zhuwenwen committed
39
#### 注意事项
zhuwenwen's avatar
zhuwenwen committed
40
41
42
+ 若使用 pip install 下载安装过慢,可添加源:-i https://pypi.tuna.tsinghua.edu.cn/simple/

## 验证
zhuwenwen's avatar
zhuwenwen committed
43
44
45
46
- python -c "import colossalai; print(colossalai.\_\_version__)",版本号与官方版本同步,查询该软件的版本号,例如0.1.13;

## Known Issue
-
zhuwenwen's avatar
zhuwenwen committed
47

zhuwenwen's avatar
zhuwenwen committed
48
## 参考资料
zhuwenwen's avatar
zhuwenwen committed
49
- [README_ORIGIN](README_ORIGIN.md)
zhuwenwen's avatar
zhuwenwen committed
50
- [README_zh-Hans](README_zh-Hans.md)
zhuwenwen's avatar
zhuwenwen committed
51
- [https://github.com/hpcaitech/ColossalAI](https://github.com/hpcaitech/ColossalAI)
zhuwenwen's avatar
zhuwenwen committed
52
53
54
55
56
57
58
59
60