GitLab

* impl ColoDDP for ColoTensor

* polish code

* refactor parallel action

* polish unit tests

Co-authored-by: github-actions <github-actions@github.com>

* polish test_gpt

* update op unit tests

* update test model

* refactor colo-tensor and update linear op

* polish code

* polish code

* update ops and unit tests

* update unit tests

* polish code

* rename dist_spec module

* polish code

* polish code

* remove unneeded import

* fix pipelinable

code style

Co-authored-by: “Arsmart123 <202476410arsmart@gmail.com>

[NFC] polish colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax.cpp code style (#959)

[NFC] polish colossalai/kernel/cuda_native/csrc/kernels/include/cross_entropy_layer.h code style (#957)

Co-authored-by: RichardoLuo <14049555596@qq.com>

Co-authored-by: 何晓昕 <cautious@hexiaoxins-MacBook-Pro.local>

Co-authored-by: Jiatong <jiatong.han@u.nus.edu>

Co-authored-by: jnbai <897086360@qq.com>

[NFC] polish pre-commit run --files colossalai/kernel/cuda_native/csrc/scaled_upper_triang_masked_softmax_cuda.cu code style (#943)