GitLab

* Azure pipelines build badge

* Update README.md

* add license badge

* update examples submodule

* install requirements.txt with install script

* add dockerfile

* Enables NCCL backend in @distributed_test

* Adds pytest-forked to avoid CUDA re-initialization issue.

* paste typo

* transcription typo

* Adding testing documentation to README.md

* Add pytest to requirements.txt

update install to use pdcp to distribute wheels

* add allreduce test

* comment out set rank to cuda for now

* switched back to gloo

* Adds distributed_test decorator and some unit tests.

* Setting NCCL backend.

* Parametrizes test.

* rank -> local_rank

* Temporarily disable CUDA initialization.

Fixing file permissions.

Lamb CUDA Kernels

Different Optimizers in DeepSpeed.