GitLab

* Refactor to allow more flexible treatment of multiple optimizers/models/losses

* Adding _process_optimizers.py

* Created L0 tests (now passing).

* fix: minor print typo (#234)

* make L1 results easier to read

* L0 multiple model/optimizer/loss test fleshed out

* Adding test that master params remain synced across distributed processes

* Docstring updates

* Docstring updates

Fix dispatch where we have a parameter group with multiple
combinations of types
Optionally apply weight decay after momentum

Initial implementation, all fp32
Tested against torch.optim.sgd