Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
nni
Commits
56a1575b
Commit
56a1575b
authored
Jun 23, 2019
by
suiguoxin
Browse files
add config test and Hpo result
parent
37f4b126
Changes
5
Show whitespace changes
Inline
Side-by-side
Showing
5 changed files
with
29 additions
and
3 deletions
+29
-3
docs/en_US/CommunitySharings/HpoComparision.md
docs/en_US/CommunitySharings/HpoComparision.md
+1
-0
examples/trials/auto-gbdt/config.yml
examples/trials/auto-gbdt/config.yml
+1
-1
examples/trials/auto-gbdt/config_metis.yml
examples/trials/auto-gbdt/config_metis.yml
+1
-1
examples/trials/auto-gbdt/config_pai.yml
examples/trials/auto-gbdt/config_pai.yml
+1
-1
test/config_test/tuners/mnist-gp.test.yml
test/config_test/tuners/mnist-gp.test.yml
+25
-0
No files found.
docs/en_US/CommunitySharings/HpoComparision.md
View file @
56a1575b
...
...
@@ -98,6 +98,7 @@ The total search space is 1,204,224, we set the number of maximum trial to 1000.
| HyperBand |0.414065|0.415222|0.417628|
| HyperBand |0.416807|0.417549|0.418828|
| HyperBand |0.415550|0.415977|0.417186|
| GP |0.414353|0.418563|0.420263|
For Metis, there are about 300 trials because it runs slowly due to its high time complexity O(n^3) in Gaussian Process.
...
...
examples/trials/auto-gbdt/config.yml
View file @
56a1575b
...
...
@@ -9,7 +9,7 @@ searchSpacePath: search_space.json
#choice: true, false
useAnnotation
:
false
tuner
:
#choice: TPE, Random, Anneal, Evolution, BatchTuner, MetisTuner
#choice: TPE, Random, Anneal, Evolution, BatchTuner, MetisTuner
, GPTuner
#SMAC (SMAC should be installed through nnictl)
builtinTunerName
:
TPE
classArgs
:
...
...
examples/trials/auto-gbdt/config_metis.yml
View file @
56a1575b
...
...
@@ -9,7 +9,7 @@ searchSpacePath: search_space_metis.json
#choice: true, false
useAnnotation
:
false
tuner
:
#choice: TPE, Random, Anneal, Evolution, BatchTuner, MetisTuner
#choice: TPE, Random, Anneal, Evolution, BatchTuner, MetisTuner
, GPTuner
#SMAC (SMAC should be installed through nnictl)
builtinTunerName
:
MetisTuner
classArgs
:
...
...
examples/trials/auto-gbdt/config_pai.yml
View file @
56a1575b
...
...
@@ -9,7 +9,7 @@ searchSpacePath: search_space.json
#choice: true, false
useAnnotation
:
false
tuner
:
#choice: TPE, Random, Anneal, Evolution, BatchTuner, MetisTuner
#choice: TPE, Random, Anneal, Evolution, BatchTuner, MetisTuner
, GPTuner
#SMAC (SMAC should be installed through nnictl)
builtinTunerName
:
TPE
classArgs
:
...
...
test/config_test/tuners/mnist-gp.test.yml
0 → 100644
View file @
56a1575b
authorName
:
nni
experimentName
:
default_test
maxExecDuration
:
5m
maxTrialNum
:
2
trialConcurrency
:
1
searchSpacePath
:
search_space.json
tuner
:
builtinTunerName
:
GPTuner
classArgs
:
optimize_mode
:
maximize
assessor
:
builtinAssessorName
:
Medianstop
classArgs
:
optimize_mode
:
maximize
trial
:
codeDir
:
../../../examples/trials/mnist
command
:
python3 mnist.py --batch_num
100
gpuNum
:
0
useAnnotation
:
false
multiPhase
:
false
multiThread
:
false
trainingServicePlatform
:
local
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment