Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
d164867d
Commit
d164867d
authored
Apr 03, 2019
by
lukovnikov
Browse files
- updated docs for optimization
parent
1758c8fc
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
2 deletions
+3
-2
tests/optimization_test.py
tests/optimization_test.py
+3
-2
No files found.
tests/optimization_test.py
View file @
d164867d
...
...
@@ -20,7 +20,8 @@ import unittest
import
torch
from
pytorch_pretrained_bert
import
BertAdam
,
WarmupCosineWithRestartsSchedule
from
pytorch_pretrained_bert
import
BertAdam
from
pytorch_pretrained_bert.optimization
import
WarmupCosineWithWarmupRestartsSchedule
from
matplotlib
import
pyplot
as
plt
import
numpy
as
np
...
...
@@ -50,7 +51,7 @@ class OptimizationTest(unittest.TestCase):
class
WarmupCosineWithRestartsTest
(
unittest
.
TestCase
):
def
test_it
(
self
):
m
=
WarmupCosineWithRestartsSchedule
(
warmup
=
0.
2
,
t_total
=
1
,
cycles
=
3
)
m
=
WarmupCosineWith
Warmup
RestartsSchedule
(
warmup
=
0.
05
,
t_total
=
1
,
cycles
=
3
)
x
=
np
.
arange
(
0
,
1000
)
/
1000
y
=
[
m
.
get_lr_
(
xe
)
for
xe
in
x
]
plt
.
plot
(
y
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment