Added changes for analysis Adam.

d2f16726 · Tim Dettmers · 0c5fa5a6 · d2f16726
Commit d2f16726 authored Oct 21, 2021 by Tim Dettmers
Show whitespace changes
Inline Side-by-side

Showing with 1 addition and 0 deletions

CHANGELOG.md CHANGELOG.md +1 -0

No files found.
--- a/CHANGELOG.md
+++ b/CHANGELOG.md
@@ -28,6 +28,7 @@ Features:
 Features:
 - Added `skip_zeros` for block-wise and 32-bit optimizers. This ensures correct updates for sparse gradients and sparse models.
 - Added support for Kepler GPUs. (#4)
+ - Added Analysis Adam to track 8-bit vs 32-bit quantization errors over time.

 Bug fixes:
 - fixed "undefined symbol: \_\_fatbinwrap_38" error for P100 GPUs on CUDA 10.1 (#5)