Skip to content

GitLab

Unverified Commit 84028786 authored by jjsjann123's avatar jjsjann123 Committed by GitHub
Browse files

Merge pull request #233 from DTennant/patch-1 

Fix a typo in optimized_sync_batchnorm_kernel.py
parents a8c2b7dd 9b114c15
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
apex/parallel/optimized_sync_batchnorm_kernel.py
View file @ 84028786
...@@ -51,7 +51,7 @@ class SyncBatchnormFunction(Function): ...@@ -51,7 +51,7 @@ class SyncBatchnormFunction(Function):
running_variance.data = running_variance.data * (1-momentum) + momentum*r_v_inc running_variance.data = running_variance.data * (1-momentum) + momentum*r_v_inc
else: else:
mean = running_mean.data mean = running_mean.data
inv_std = 1.0 / torch.sqrt(running_var.data + eps) inv_std = 1.0 / torch.sqrt(running_variance.data + eps)
ctx.save_for_backward(input, weight, mean, inv_std) ctx.save_for_backward(input, weight, mean, inv_std)
ctx.process_group = process_group ctx.process_group = process_group
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment