Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
apex
Commits
53fd093d
Commit
53fd093d
authored
Apr 12, 2019
by
Michael Carilli
Browse files
Update Wil's code + typo
parent
3c53cf81
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
2 deletions
+2
-2
apex/amp/_process_optimizer.py
apex/amp/_process_optimizer.py
+1
-1
csrc/fused_adam_cuda_kernel.cu
csrc/fused_adam_cuda_kernel.cu
+1
-1
No files found.
apex/amp/_process_optimizer.py
View file @
53fd093d
...
@@ -229,7 +229,7 @@ def post_backward_with_master_weights_fused(self, scaler):
...
@@ -229,7 +229,7 @@ def post_backward_with_master_weights_fused(self, scaler):
stash
=
self
.
_amp_stash
stash
=
self
.
_amp_stash
stash
.
scale
=
scaler
.
loss_scale
()
stash
.
scale
=
scaler
.
loss_scale
()
stash
.
grads
=
[[
param
.
grad
.
data
for
param
in
group
]
for
group
in
self
.
fp16_groups
]
stash
.
grads
=
[[
param
.
grad
.
data
for
param
in
group
]
for
group
in
self
.
fp16_groups
]
stash
.
output_params
=
[[
param
for
param
in
in
group
]
for
group
in
self
.
fp16_groups
]
stash
.
output_params
=
[[
param
for
param
in
group
]
for
group
in
self
.
fp16_groups
]
norm_groups
=
[]
norm_groups
=
[]
skip
=
False
skip
=
False
...
...
csrc/fused_adam_cuda_kernel.cu
View file @
53fd093d
...
@@ -65,7 +65,7 @@ struct AdamFunctor
...
@@ -65,7 +65,7 @@ struct AdamFunctor
__device__
__forceinline__
void
operator
()(
__device__
__forceinline__
void
operator
()(
int
chunk_size
,
int
chunk_size
,
volatile
int
*
noop_gmem
,
volatile
int
*
noop_gmem
,
TensorList
<
DEPTH
>&
tl
,
TensorList
Metadata
<
DEPTH
>&
tl
,
const
float
b1
,
const
float
b1
,
const
float
b2
,
const
float
b2
,
const
float
eps
,
const
float
eps
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment