Skip to content

GitLab

Commit 471daf1b authored by lukovnikov's avatar lukovnikov
Browse files

changing docker

parent 90246133
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
pytorch_pretrained_bert/optimization.py
View file @ 471daf1b
...@@ -84,7 +84,7 @@ class WarmupCosineWithRestartsSchedule(WarmupCosineSchedule): ...@@ -84,7 +84,7 @@ class WarmupCosineWithRestartsSchedule(WarmupCosineSchedule):
return progress / self.warmup return progress / self.warmup
else: else:
progress = (progress - self.warmup) / (1 - self.warmup) # progress after warmup progress = (progress - self.warmup) / (1 - self.warmup) # progress after warmup
ret = 0.5 * (1. + math.cos(math.pi * ((self.cycles * 2 * progress) % 1))) ret = 0.5 * (1. + math.cos(math.pi * ((self.cycles * progress) % 1)))
return ret return ret
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment