<h3><ahref="https://arxiv.org/abs/2110.14883"> Paper </a> | <ahref="https://www.colossalai.org/"> Documentation </a> | <ahref="https://github.com/hpcaitech/ColossalAI/discussions"> Forum </a> | <ahref="https://medium.com/@hpcaitech"> Blog </a></h3>
</div>
An integrated large-scale model training system with efficient parallelization techniques.
An integrated large-scale model training system with efficient parallelization techniques.
Paper: [Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training](https://arxiv.org/abs/2110.14883)
Blog: [Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Training](https://www.hpcaitech.com/blog)
## Installation
## Installation
### PyPI
### PyPI
...
@@ -34,10 +33,6 @@ Install and enable CUDA kernel fusion (compulsory installation when using fused
...
@@ -34,10 +33,6 @@ Install and enable CUDA kernel fusion (compulsory installation when using fused