Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "fef36cea4254a3afe9a8b97ea10f40376ceef91f"
Unverified Commit 0044372c authored by tmarkstrum's avatar tmarkstrum Committed by GitHub
Browse files

[chore] Update the CHANGELOG to add details about the new feature that enables... 

[chore] Update the CHANGELOG to add details about the new feature that enables reduce_scatter overlap in backward propagation (#906)

* updated the change log

* improve the change log
parent 0a526bcb
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
CHANGELOG.md
View file @ 0044372c
......@@ -7,9 +7,12 @@ and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0
## [0.4.5] - TBD
### Added
- FSDP: Added process_group_reduce_scatter parameter to allow users to pass in the process group that is used for reduce scatter operation. [#897]
- FSDP: Added state_dict_on_rank_0_only flag allow user choose to return full state dict on rank 0 and return empty dict non-rank 0 to prevent OOM [#844]
### Changed
- FSDP: Enabled reduce_scatter operation to overlap with all_gather stream and computation stream in backward propagation.
This change increases FSDP's throughput. To roll back this change, please pass ProcessGroupName.default to the process_group_reduce_scatter API parameter in FSDP [#897]
## [0.4.4] - 2021-12-21
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment