Update deepspeed_utils.py (#270)

* Removing handle_overflow debugging code in deepspeed_utils.py

* Removing handle_overflow debugging code in deepspeed_zero_optimizer.py

Removing unnecessary overflow handle code. Not sure why it was there in the first place.

deepspeed/pt/deepspeed_utils.py

@@ -100,7 +100,6 @@ class CheckOverflow(object):
             return True
         else:
             if cpu_sum == float('inf') or cpu_sum == -float('inf') or cpu_sum != cpu_sum:
-                _handle_overflow(cpu_sum, x, i)
                 return True
             return False
 

deepspeed/pt/deepspeed_zero_optimizer.py

@@ -1269,8 +1269,6 @@ class FP16_DeepSpeedZeroOptimizer(object):
             return True
         else:
             if cpu_sum == float('inf') or cpu_sum == -float('inf') or cpu_sum != cpu_sum:
-                if dist.get_rank() == 0 and j is not None:
-                    _handle_overflow(cpu_sum, x, j)
                 return True
             return False