Update engine.py (#458)

Do not load optimizer states for fp32 if flag set to False.

Update engine.py (#458)
Do not load optimizer states for fp32 if flag set to False.
67176383 · Sylwester Klocek · GitHub · 95575579 · 67176383
Unverified Commit 67176383 authored Oct 05, 2020 by Sylwester Klocek Committed by GitHub Oct 05, 2020
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

deepspeed/runtime/engine.py deepspeed/runtime/engine.py +1 -1

No files found.
--- a/deepspeed/runtime/engine.py
+++ b/deepspeed/runtime/engine.py
@@ -1227,7 +1227,7 @@ class DeepSpeedEngine(Module):
                self.optimizer.load_state_dict(
                    checkpoint['optimizer'],
                    load_optimizer_states=load_optimizer_states)
-            else:
+            elif load_optimizer_states:
                self.optimizer.load_state_dict(checkpoint['optimizer'])

        if load_lr_scheduler_states and self.lr_scheduler is not None: