Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Uni-Core
Commits
979f972a
Unverified
Commit
979f972a
authored
Jul 10, 2022
by
Guolin Ke
Committed by
GitHub
Jul 10, 2022
Browse files
Update fused_adam.py
parent
8e50c5d4
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
unicore/optim/fused_adam.py
unicore/optim/fused_adam.py
+2
-2
No files found.
unicore/optim/fused_adam.py
View file @
979f972a
...
...
@@ -53,9 +53,9 @@ class FusedAdam(torch.optim.Optimizer):
lr
=
1e-3
,
bias_correction
=
True
,
betas
=
(
0.9
,
0.999
),
eps
=
1e-8
,
weight_decay
=
0.
,
amsgrad
=
False
):
global
fused_adam
_cuda_v2
global
unicore_
fused_adam
import
importlib
fused_adam
_cuda_v2
=
importlib
.
import_module
(
"fused_adam
_cuda_v2
"
)
unicore_
fused_adam
=
importlib
.
import_module
(
"
unicore_
fused_adam"
)
if
amsgrad
:
raise
RuntimeError
(
"FusedAdam does not support the AMSGrad variant."
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment