tests/test_tensor/test_mix_gather.py · d655eea515c1dc6c68802a86a1b8c49ff32b6038 · OpenDAS / ColossalAI

[autoparallel] mix gather (#1977) · d655eea5

Genghan Zhang authored Nov 23, 2022

* Add mix-gather

* Add comments

* Add comments

* Polish comments

* Change the global rank assumption

* Add tests

* Add two-step tests

* Fix 10 and 01

* Skip test becasue the number of GPUs

d655eea5

test_mix_gather.py 12.5 KB

Replace test_mix_gather.py