Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
dlib
Commits
562d1b75
Commit
562d1b75
authored
Aug 03, 2017
by
Davis King
Browse files
Clarified spec
parent
a1f94e16
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
dlib/dnn/trainer_abstract.h
dlib/dnn/trainer_abstract.h
+3
-3
No files found.
dlib/dnn/trainer_abstract.h
View file @
562d1b75
...
...
@@ -230,15 +230,15 @@ namespace dlib
- This trainer will use an explicit learning rate schedule defined by
the learning rate values in get_learning_rate_schedule(). For
example, if get_learning_rate_schedule() returned {0.1, 0.09, 0.08,
0.07, 0.6} then the first training mini-batch would use a learning
0.07, 0.
0
6} then the first training mini-batch would use a learning
rate of 0.1, then the next training mini-batch uses 0.09, and then
0.8, and so on until the end of the schedule is reached.
If you continue to run training after the end of the schedule has
been reached then the learning rate will be fixed to 0.99 times the
final value. So in our example, eventually the learning rate would
be fixed to 0.99*0.6. This allows you to test if we have reached the
end of the schedule by checking if get_learning_rate() >= 0.6.
be fixed to 0.99*0.
0
6. This allows you to test if we have reached the
end of the schedule by checking if get_learning_rate() >= 0.
0
6.
!*/
unsigned
long
get_steps_without_progress
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment