colossalai/nn/layer/parallel_2d/layers.py · 7bc5a8e338a1240070ca82f96721c451060f1a70 · OpenDAS / ColossalAI · GitLab

Find file Blame History Permalink

[utils] refactor parallel layers checkpoint and bcast model on loading checkpoint (#1548) · ae71036c
ver217 authored Sep 06, 2022
```
* refactor parallel layer

* broadcast rank0 model after load ckpt
```
ae71036c

layers.py 49.3 KB