tests/test_moe/test_grad_handler.py · f71e63b0f39a108c512d81afd5272c41a977708c · OpenDAS / ColossalAI

[moe] support optimizer checkpoint (#5015) · f71e63b0

Xuanlei Zhao authored Nov 08, 2023

* Refactor MoE Manager setup method

* unshard optim ckpt

* optim io

* update transformer version

* update requirements

* update ckpt

* update ckpt

* update ckpt

* fix engine

* fix engine

f71e63b0

test_grad_handler.py 2.63 KB

Replace test_grad_handler.py