GitLab

* [doc]: AdaScale example and notes

* formatted notes correctly as suggested by Benjamin

* added feature and unit test to make sure lr_scheduler works

* update the example with lr_scheduler

* fixed doc with "make html"

* addressed Mike's suggestions

Thanks Jessica for the heads up !

* add logo

* Update README.md
Co-authored-by: Vittorio Caggiano <caggiano@fb.com>

* added AdaScale to README

* [adascale] added gradient accumulation

- added gradient accumulation
- tested with cifar full trainings with different value of accumulation
and verified the full accuracy is obtained
- also removed the patch optimize flag until we need it

* [adascale] adding pytest

- added basic and ddp tests and grad_accum
- closes #195

* added changelog

* added ddp grad_accum test

* moved ddp and non-ddp tests into separate files

* added checkpoint test

* more doc

* addressed Mike's comments

* make the basic example usable out of the box
* clarify

* fixing the readme for oss

* Add implementation of AdaScale

* add adascale docs

add badges and link to readthedoc

Add a small tutorial, similar to the OSS README