Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
nni
Commits
e8d253c0
Unverified
Commit
e8d253c0
authored
Feb 07, 2020
by
SparkSnail
Committed by
GitHub
Feb 07, 2020
Browse files
Fix pai examples (#1996)
parent
649a9c38
Changes
32
Hide whitespace changes
Inline
Side-by-side
Showing
12 changed files
with
234 additions
and
11 deletions
+234
-11
examples/trials/mnist-tfv1/config_pai.yml
examples/trials/mnist-tfv1/config_pai.yml
+5
-2
examples/trials/mnist-tfv1/config_paiYarn.yml
examples/trials/mnist-tfv1/config_paiYarn.yml
+32
-0
examples/trials/nas_cifar10/config_paiYarn_ppo.yml
examples/trials/nas_cifar10/config_paiYarn_ppo.yml
+31
-0
examples/trials/nas_cifar10/config_pai_ppo.yml
examples/trials/nas_cifar10/config_pai_ppo.yml
+4
-1
examples/trials/network_morphism/FashionMNIST/config_pai.yml
examples/trials/network_morphism/FashionMNIST/config_pai.yml
+5
-2
examples/trials/network_morphism/FashionMNIST/config_paiYarn.yml
...s/trials/network_morphism/FashionMNIST/config_paiYarn.yml
+39
-0
examples/trials/network_morphism/cifar10/config_pai.yml
examples/trials/network_morphism/cifar10/config_pai.yml
+5
-2
examples/trials/network_morphism/cifar10/config_paiYarn.yml
examples/trials/network_morphism/cifar10/config_paiYarn.yml
+39
-0
examples/trials/sklearn/classification/config_pai.yml
examples/trials/sklearn/classification/config_pai.yml
+5
-2
examples/trials/sklearn/classification/config_paiYarn.yml
examples/trials/sklearn/classification/config_paiYarn.yml
+32
-0
examples/trials/sklearn/regression/config_pai.yml
examples/trials/sklearn/regression/config_pai.yml
+5
-2
examples/trials/sklearn/regression/config_paiYarn.yml
examples/trials/sklearn/regression/config_paiYarn.yml
+32
-0
No files found.
examples/trials/mnist-tfv1/config_pai.yml
View file @
e8d253c0
...
@@ -23,10 +23,13 @@ trial:
...
@@ -23,10 +23,13 @@ trial:
memoryMB
:
8196
memoryMB
:
8196
#The docker image to run nni job on pai
#The docker image to run nni job on pai
image
:
msranni/nni:latest
image
:
msranni/nni:latest
nniManagerNFSMountPath
:
/home/user/mnt
containerNFSMountPath
:
/mnt/data/user
paiStoragePlugin
:
team_wise
paiConfig
:
paiConfig
:
#The username to login pai
#The username to login pai
userName
:
username
userName
:
username
#The
password
to login pai
#The
token
to login pai
passWord
:
password
token
:
token
#The host of restful server of pai
#The host of restful server of pai
host
:
10.10.10.10
host
:
10.10.10.10
\ No newline at end of file
examples/trials/mnist-tfv1/config_paiYarn.yml
0 → 100644
View file @
e8d253c0
authorName
:
default
experimentName
:
example_mnist
trialConcurrency
:
1
maxExecDuration
:
1h
maxTrialNum
:
10
#choice: local, remote, pai
trainingServicePlatform
:
paiYarn
searchSpacePath
:
search_space.json
#choice: true, false
useAnnotation
:
false
tuner
:
#choice: TPE, Random, Anneal, Evolution, BatchTuner, MetisTuner, GPTuner
#SMAC (SMAC should be installed through nnictl)
builtinTunerName
:
TPE
classArgs
:
#choice: maximize, minimize
optimize_mode
:
maximize
trial
:
command
:
python3 mnist.py
codeDir
:
.
gpuNum
:
0
cpuNum
:
1
memoryMB
:
8196
#The docker image to run nni job on pai
image
:
msranni/nni:latest
paiYarnConfig
:
#The username to login pai
userName
:
username
#The password to login pai
passWord
:
password
#The host of restful server of pai
host
:
10.10.10.10
\ No newline at end of file
examples/trials/nas_cifar10/config_paiYarn_ppo.yml
0 → 100644
View file @
e8d253c0
authorName
:
Unknown
experimentName
:
enas_macro
trialConcurrency
:
20
maxExecDuration
:
2400h
maxTrialNum
:
20000
#choice: local, remote
trainingServicePlatform
:
paiYarn
#choice: true, false
useAnnotation
:
true
multiPhase
:
false
versionCheck
:
false
nniManagerIp
:
0.0.0.0
tuner
:
builtinTunerName
:
PPOTuner
classArgs
:
optimize_mode
:
maximize
trials_per_update
:
60
epochs_per_update
:
20
minibatch_size
:
6
trial
:
command
:
sh ./macro_cifar10_pai.sh
codeDir
:
./
gpuNum
:
1
cpuNum
:
1
memoryMB
:
8196
image
:
msranni/nni:latest
virtualCluster
:
nni
paiYarnConfig
:
userName
:
your_account
passWord
:
your_passwd
host
:
0.0.0.0
examples/trials/nas_cifar10/config_pai_ppo.yml
View file @
e8d253c0
...
@@ -25,7 +25,10 @@ trial:
...
@@ -25,7 +25,10 @@ trial:
memoryMB
:
8196
memoryMB
:
8196
image
:
msranni/nni:latest
image
:
msranni/nni:latest
virtualCluster
:
nni
virtualCluster
:
nni
nniManagerNFSMountPath
:
/home/user/mnt
containerNFSMountPath
:
/mnt/data/user
paiStoragePlugin
:
team_wise
paiConfig
:
paiConfig
:
userName
:
your_account
userName
:
your_account
passWord
:
your_
pwd
token
:
your_
token
host
:
0.0.0.0
host
:
0.0.0.0
examples/trials/network_morphism/FashionMNIST/config_pai.yml
View file @
e8d253c0
...
@@ -30,10 +30,13 @@ trial:
...
@@ -30,10 +30,13 @@ trial:
memoryMB
:
8196
memoryMB
:
8196
#The docker image to run nni job on pai
#The docker image to run nni job on pai
image
:
msranni/nni:latest
image
:
msranni/nni:latest
nniManagerNFSMountPath
:
/home/user/mnt
containerNFSMountPath
:
/mnt/data/user
paiStoragePlugin
:
team_wise
paiConfig
:
paiConfig
:
#The username to login pai
#The username to login pai
userName
:
username
userName
:
username
#The
password
to login pai
#The
token
to login pai
passWord
:
password
token
:
token
#The host of restful server of pai
#The host of restful server of pai
host
:
10.10.10.10
host
:
10.10.10.10
\ No newline at end of file
examples/trials/network_morphism/FashionMNIST/config_paiYarn.yml
0 → 100644
View file @
e8d253c0
authorName
:
default
experimentName
:
example_FashionMNIST-network-morphism
trialConcurrency
:
1
maxExecDuration
:
24h
maxTrialNum
:
10
#choice: local, remote, pai
trainingServicePlatform
:
paiYarn
#choice: true, false
useAnnotation
:
false
tuner
:
#choice: TPE, Random, Anneal, Evolution, BatchTuner, NetworkMorphism
#SMAC (SMAC should be installed through nnictl)
builtinTunerName
:
NetworkMorphism
classArgs
:
#choice: maximize, minimize
optimize_mode
:
maximize
# for now, this tuner only supports cv domain
task
:
cv
#input image width
input_width
:
28
#input image channel
input_channel
:
1
#number of classes
n_output_node
:
10
trial
:
command
:
python3 FashionMNIST_keras.py
codeDir
:
.
gpuNum
:
1
cpuNum
:
1
memoryMB
:
8196
#The docker image to run nni job on pai
image
:
msranni/nni:latest
paiYarnConfig
:
#The username to login pai
userName
:
username
#The password to login pai
passWord
:
password
#The host of restful server of pai
host
:
10.10.10.10
\ No newline at end of file
examples/trials/network_morphism/cifar10/config_pai.yml
View file @
e8d253c0
...
@@ -30,10 +30,13 @@ trial:
...
@@ -30,10 +30,13 @@ trial:
memoryMB
:
8196
memoryMB
:
8196
#The docker image to run nni job on pai
#The docker image to run nni job on pai
image
:
msranni/nni:latest
image
:
msranni/nni:latest
nniManagerNFSMountPath
:
/home/user/mnt
containerNFSMountPath
:
/mnt/data/user
paiStoragePlugin
:
team_wise
paiConfig
:
paiConfig
:
#The username to login pai
#The username to login pai
userName
:
username
userName
:
username
#The
password
to login pai
#The
token
to login pai
passWord
:
password
token
:
token
#The host of restful server of pai
#The host of restful server of pai
host
:
10.10.10.10
host
:
10.10.10.10
\ No newline at end of file
examples/trials/network_morphism/cifar10/config_paiYarn.yml
0 → 100644
View file @
e8d253c0
authorName
:
default
experimentName
:
example_cifar10-network-morphism
trialConcurrency
:
1
maxExecDuration
:
24h
maxTrialNum
:
10
#choice: local, remote, pai
trainingServicePlatform
:
paiYarn
#choice: true, false
useAnnotation
:
false
tuner
:
#choice: TPE, Random, Anneal, Evolution, BatchTuner, NetworkMorphism
#SMAC (SMAC should be installed through nnictl)
builtinTunerName
:
NetworkMorphism
classArgs
:
#choice: maximize, minimize
optimize_mode
:
maximize
# for now, this tuner only supports cv domain
task
:
cv
#input image width
input_width
:
32
#input image channel
input_channel
:
3
#number of classes
n_output_node
:
10
trial
:
command
:
python3 cifar10_keras.py
codeDir
:
.
gpuNum
:
1
cpuNum
:
1
memoryMB
:
8196
#The docker image to run nni job on pai
image
:
msranni/nni:latest
paiYarnConfig
:
#The username to login pai
userName
:
username
#The password to login pai
passWord
:
password
#The host of restful server of pai
host
:
10.10.10.10
\ No newline at end of file
examples/trials/sklearn/classification/config_pai.yml
View file @
e8d253c0
...
@@ -23,10 +23,13 @@ trial:
...
@@ -23,10 +23,13 @@ trial:
memoryMB
:
8196
memoryMB
:
8196
#The docker image to run nni job on pai
#The docker image to run nni job on pai
image
:
msranni/nni:latest
image
:
msranni/nni:latest
nniManagerNFSMountPath
:
/home/user/mnt
containerNFSMountPath
:
/mnt/data/user
paiStoragePlugin
:
team_wise
paiConfig
:
paiConfig
:
#The username to login pai
#The username to login pai
userName
:
username
userName
:
username
#The
password
to login pai
#The
token
to login pai
passWord
:
password
token
:
token
#The host of restful server of pai
#The host of restful server of pai
host
:
10.10.10.10
host
:
10.10.10.10
\ No newline at end of file
examples/trials/sklearn/classification/config_paiYarn.yml
0 → 100644
View file @
e8d253c0
authorName
:
default
experimentName
:
example_sklearn
trialConcurrency
:
1
maxExecDuration
:
1h
maxTrialNum
:
100
#choice: local, remote, pai
trainingServicePlatform
:
paiYarn
searchSpacePath
:
search_space.json
#choice: true, false
useAnnotation
:
false
tuner
:
#choice: TPE, Random, Anneal, Evolution, BatchTuner,MetisTuner
#SMAC (SMAC should be installed through nnictl)
builtinTunerName
:
TPE
classArgs
:
#choice: maximize, minimize
optimize_mode
:
maximize
trial
:
command
:
python3 main.py
codeDir
:
.
gpuNum
:
0
cpuNum
:
1
memoryMB
:
8196
#The docker image to run nni job on pai
image
:
msranni/nni:latest
paiYarnConfig
:
#The username to login pai
userName
:
username
#The password to login pai
passWord
:
password
#The host of restful server of pai
host
:
10.10.10.10
\ No newline at end of file
examples/trials/sklearn/regression/config_pai.yml
View file @
e8d253c0
...
@@ -23,10 +23,13 @@ trial:
...
@@ -23,10 +23,13 @@ trial:
memoryMB
:
8196
memoryMB
:
8196
#The docker image to run nni job on pai
#The docker image to run nni job on pai
image
:
msranni/nni:latest
image
:
msranni/nni:latest
nniManagerNFSMountPath
:
/home/user/mnt
containerNFSMountPath
:
/mnt/data/user
paiStoragePlugin
:
team_wise
paiConfig
:
paiConfig
:
#The username to login pai
#The username to login pai
userName
:
username
userName
:
username
#The
password
to login pai
#The
token
to login pai
passWord
:
password
token
:
token
#The host of restful server of pai
#The host of restful server of pai
host
:
10.10.10.10
host
:
10.10.10.10
\ No newline at end of file
examples/trials/sklearn/regression/config_paiYarn.yml
0 → 100644
View file @
e8d253c0
authorName
:
default
experimentName
:
example_sklearn
trialConcurrency
:
1
maxExecDuration
:
1h
maxTrialNum
:
100
#choice: local, remote, pai
trainingServicePlatform
:
paiYarn
searchSpacePath
:
search_space.json
#choice: true, false
useAnnotation
:
false
tuner
:
#choice: TPE, Random, Anneal, Evolution, BatchTuner, MetisTuner
#SMAC (SMAC should be installed through nnictl)
builtinTunerName
:
TPE
classArgs
:
#choice: maximize, minimize
optimize_mode
:
maximize
trial
:
command
:
python3 main.py
codeDir
:
.
gpuNum
:
0
cpuNum
:
1
memoryMB
:
8196
#The docker image to run nni job on pai
image
:
msranni/nni:latest
paiYarnConfig
:
#The username to login pai
userName
:
username
#The password to login pai
passWord
:
password
#The host of restful server of pai
host
:
10.10.10.10
\ No newline at end of file
Prev
1
2
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment