[chore] 0.4.0 release (#757)

Co-authored-by: Min Xu <min.xu.public@gmail.com>

CHANGELOG.md

@@ -6,6 +6,13 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
 
 ## NEXT - TBD
 ### Fixed
+
+
+### Added
+
+
+## [0.4.0] - 2021-07-31
+### Fixed
 - FSDP: fixed final backward callback in certain activation checkpointed cases. Before this fix,
         if a model is activation checkpointed in a certain way, the final backward
         callback can fire incorrectly. That's due to autograd and reentrant backward
@@ -20,6 +27,7 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
         number of GPUs. Compared with the `no_sync` context, this mode consumes less
         GPU memory but uses more networking bandwidth. [#752]
 
+
 ## [0.3.9] - 2021-07-26
 ### Fixed
 - FSDP: fixed metadata saving and shard consolidation for MoE cases. When a model has

docs/source/conf.py

@@ -29,7 +29,7 @@ copyright = "2020-2021, Facebook AI Research"
 author = "Facebook AI Research"
 
 # The full version, including alpha/beta/rc tags
-release = "0.3.9"
+release = "0.4.0"
 
 
 # -- General configuration ---------------------------------------------------

fairscale/__init__.py

@@ -4,7 +4,7 @@
 # LICENSE file in the root directory of this source tree.
 
 # Please update the doc version in docs/source/conf.py as well.
-__version__ = "0.3.9"
+__version__ = "0.4.0"
 
 ################################################################################
 # Import most common subpackages