Skip to content

GitLab

Commit 96b017a8 authored by Kexin Yu's avatar Kexin Yu
Browse files

add printing to test

parent 90729bc8
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
apex/contrib/optimizers/fused_lamb.py
View file @ 96b017a8
...@@ -81,6 +81,7 @@ class FusedLAMB(torch.optim.Optimizer): ...@@ -81,6 +81,7 @@ class FusedLAMB(torch.optim.Optimizer):
self.adam_w_mode = 1 if adam_w_mode else 0 self.adam_w_mode = 1 if adam_w_mode else 0
self.set_grad_none = set_grad_none self.set_grad_none = set_grad_none
print("apex.contrib.optimiziers.FusedLAMB: testing global gradient clipping")
def zero_grad(self): def zero_grad(self):
if self.set_grad_none: if self.set_grad_none:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment