GitLab

* Add Sync buffer in CheckpointHook

* add reduce_params in fp16_utils.py

* change default value of sync_buffer to False

* Add world size check

* reset sync_buffer to false

* fix world_size

* Move dist functions into dist_utils.py

* fix small bugs

* Deprecation compatibility

* Change according to comments