Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
nni
Commits
05913424
Commit
05913424
authored
Aug 05, 2019
by
suiguoxin
Browse files
Merge branch 'master' into quniform-tuners
parents
e3c8552f
1dab3118
Changes
86
Expand all
Show whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
526 additions
and
59 deletions
+526
-59
docs/img/parallel_tpe_search_ei2.PNG
docs/img/parallel_tpe_search_ei2.PNG
+0
-0
docs/img/parallel_tpe_search_kb.PNG
docs/img/parallel_tpe_search_kb.PNG
+0
-0
docs/img/parallel_tpe_search_qEI.PNG
docs/img/parallel_tpe_search_qEI.PNG
+0
-0
docs/img/parallel_tpe_search_result.PNG
docs/img/parallel_tpe_search_result.PNG
+0
-0
docs/img/parallel_tpe_search_tpe.PNG
docs/img/parallel_tpe_search_tpe.PNG
+0
-0
docs/zh_CN/Nnictl.md
docs/zh_CN/Nnictl.md
+21
-9
docs/zh_CN/PaiMode.md
docs/zh_CN/PaiMode.md
+0
-6
examples/notebooks/retrieve_nni_info_with_python.ipynb
examples/notebooks/retrieve_nni_info_with_python.ipynb
+497
-0
examples/trials/auto-feature-engineering/README.md
examples/trials/auto-feature-engineering/README.md
+8
-0
examples/trials/auto-gbdt/config_pai.yml
examples/trials/auto-gbdt/config_pai.yml
+0
-4
examples/trials/cifar10_pytorch/config_pai.yml
examples/trials/cifar10_pytorch/config_pai.yml
+0
-4
examples/trials/ga_squad/config_pai.yml
examples/trials/ga_squad/config_pai.yml
+0
-4
examples/trials/mnist-advisor/config_pai.yml
examples/trials/mnist-advisor/config_pai.yml
+0
-4
examples/trials/mnist-annotation/config_pai.yml
examples/trials/mnist-annotation/config_pai.yml
+0
-4
examples/trials/mnist-batch-tune-keras/config_pai.yml
examples/trials/mnist-batch-tune-keras/config_pai.yml
+0
-4
examples/trials/mnist-keras/config_pai.yml
examples/trials/mnist-keras/config_pai.yml
+0
-4
examples/trials/mnist/config_pai.yml
examples/trials/mnist/config_pai.yml
+0
-4
examples/trials/network_morphism/FashionMNIST/config_pai.yml
examples/trials/network_morphism/FashionMNIST/config_pai.yml
+0
-4
examples/trials/network_morphism/cifar10/config_pai.yml
examples/trials/network_morphism/cifar10/config_pai.yml
+0
-4
examples/trials/sklearn/classification/config_pai.yml
examples/trials/sklearn/classification/config_pai.yml
+0
-4
No files found.
docs/img/parallel_tpe_search_ei2.PNG
0 → 100644
View file @
05913424
112 KB
docs/img/parallel_tpe_search_kb.PNG
0 → 100644
View file @
05913424
54.3 KB
docs/img/parallel_tpe_search_qEI.PNG
0 → 100644
View file @
05913424
12.1 KB
docs/img/parallel_tpe_search_result.PNG
0 → 100644
View file @
05913424
363 KB
docs/img/parallel_tpe_search_tpe.PNG
0 → 100644
View file @
05913424
9.5 KB
docs/zh_CN/Nnictl.md
View file @
05913424
...
...
@@ -114,9 +114,16 @@ nnictl 支持的命令:
*
用法
```
bash
nnictl stop
[
id
]
nnictl stop
[
OPTIONS
]
```
*
选项
| 参数及缩写 | 是否必需 | 默认值 | 说明 |
| ----------- | ----- | --- | -------------------------------- |
| id | 否 | | 要停止的 Experiment 标识 |
| --port, -p | 否 | | 要停止的 Experiment 使用的 RESTful 服务端口 |
*
详细信息及样例
1.
如果没有指定 id,并且当前有运行的 Experiment,则会停止该 Experiment,否则会输出错误信息。
...
...
@@ -132,18 +139,23 @@ nnictl 支持的命令:
nnictl stop
[
experiment_id]
```
3.
如果指定了端口,并且有运行中的 Experiment 正在使用该端口,那么这个 Experiment 将会停止。
```bash
nnictl stop --port 8080
````
3
.
可使用 'nnictl stop all' 来停止所有的 Experiment。
4
.
可使用 'nnictl stop all' 来停止所有的 Experiment。
```
bash
nnictl stop all
```
4
.
如果 id 以
*
结尾,nnictl 会停止所有匹配此通配符的 Experiment。
5
.
如果 id 以
*
结尾,nnictl 会停止所有匹配此通配符的 Experiment。
5
.
如果 id 不存在,但匹配了某个Experiment 的 id 前缀,nnictl 会停止匹配的Experiment 。
6
.
如果 id 不存在,但匹配了多个 Experiment id 的前缀,nnictl 会输出这些 id 的信息。
6
.
如果 id 不存在,但匹配了某个Experiment 的 id 前缀,nnictl 会停止匹配的Experiment 。
7
.
如果 id 不存在,但匹配了多个 Experiment id 的前缀,nnictl 会输出这些 id 的信息。
<a
name=
"update"
></a>
...
...
docs/zh_CN/PaiMode.md
View file @
05913424
...
...
@@ -34,8 +34,6 @@ trial:
cpuNum
:
1
memoryMB
:
8196
image
:
msranni/nni:latest
dataDir
:
hdfs://10.1.1.1:9000/nni
outputDir
:
hdfs://10.1.1.1:9000/nni
# 配置访问的 OpenPAI 集群
paiConfig
:
userName
:
your_pai_nni_user
...
...
@@ -54,10 +52,6 @@ paiConfig:
*
image
*
必填。 在 pai 模式中,Trial 程序由 OpenPAI 在
[
Docker 容器
](
https://www.docker.com/
)
中安排运行。 此键用来指定 Trial 程序的容器使用的 Docker 映像。
*
[
Docker Hub
](
https://hub.docker.com/
)
上有预制的 NNI Docker 映像
[
nnimsra/nni
](
https://hub.docker.com/r/msranni/nni/
)
。 它包含了用来启动 NNI Experiment 所依赖的所有 Python 包,Node 模块和 JavaScript。 生成此 Docker 映像的文件在
[
这里
](
https://github.com/Microsoft/nni/tree/master/deployment/docker/Dockerfile
)
。 可以直接使用此映像,或参考它来生成自己的映像。
*
dataDir
*
可选。 指定了 Trial 用于下载数据的 HDFS 数据目录。 格式应为 hdfs://{your HDFS host}:9000/{数据目录}
*
outputDir
*
可选。 指定了 Trial 的 HDFS 输出目录。 Trial 在完成(成功或失败)后,Trial 的 stdout, stderr 会被 NNI 自动复制到此目录中。 格式应为 hdfs://{your HDFS host}:9000/{输出目录}
*
virtualCluster
*
可选。 设置 OpenPAI 的 virtualCluster,即虚拟集群。 如果未设置此参数,将使用默认的虚拟集群。
*
shmMB
...
...
examples/notebooks/retrieve_nni_info_with_python.ipynb
0 → 100644
View file @
05913424
This diff is collapsed.
Click to expand it.
examples/trials/auto-feature-engineering/README.md
0 → 100644
View file @
05913424
**Automatic Feature Engineering in nni**
===
Now we have an
[
example
](
https://github.com/SpongebBob/tabular_automl_NNI
)
, which could automaticlly do feature engineering in nni.
These code come from our contributors. And thanks our lovely contributors!
And welcome more and more people to join us!
examples/trials/auto-gbdt/config_pai.yml
View file @
05913424
...
...
@@ -23,10 +23,6 @@ trial:
memoryMB
:
8196
#The docker image to run nni job on pai
image
:
msranni/nni:latest
#The hdfs directory to store data on pai, format 'hdfs://host:port/directory'
dataDir
:
hdfs://10.10.10.10:9000/username/nni
#The hdfs directory to store output data generated by nni, format 'hdfs://host:port/directory'
outputDir
:
hdfs://10.10.10.10:9000/username/nni
paiConfig
:
#The username to login pai
userName
:
username
...
...
examples/trials/cifar10_pytorch/config_pai.yml
View file @
05913424
...
...
@@ -23,10 +23,6 @@ trial:
memoryMB
:
8196
#The docker image to run nni job on pai
image
:
msranni/nni:latest
#The hdfs directory to store data on pai, format 'hdfs://host:port/directory'
dataDir
:
hdfs://10.10.10.10:9000/username/nni
#The hdfs directory to store output data generated by nni, format 'hdfs://host:port/directory'
outputDir
:
hdfs://10.10.10.10:9000/username/nni
paiConfig
:
#The username to login pai
userName
:
username
...
...
examples/trials/ga_squad/config_pai.yml
View file @
05913424
...
...
@@ -23,10 +23,6 @@ trial:
memoryMB
:
32869
#The docker image to run nni job on pai
image
:
msranni/nni:latest
#The hdfs directory to store data on pai, format 'hdfs://host:port/directory'
dataDir
:
hdfs://10.10.10.10:9000/username/nni
#The hdfs directory to store output data generated by nni, format 'hdfs://host:port/directory'
outputDir
:
hdfs://10.10.10.10:9000/username/nni
paiConfig
:
#The username to login pai
userName
:
username
...
...
examples/trials/mnist-advisor/config_pai.yml
View file @
05913424
...
...
@@ -27,10 +27,6 @@ trial:
memoryMB
:
8196
#The docker image to run nni job on pai
image
:
msranni/nni:latest
#The hdfs directory to store data on pai, format 'hdfs://host:port/directory'
dataDir
:
hdfs://10.10.10.10:9000/username/nni
#The hdfs directory to store output data generated by nni, format 'hdfs://host:port/directory'
outputDir
:
hdfs://10.10.10.10:9000/username/nni
paiConfig
:
#The username to login pai
userName
:
username
...
...
examples/trials/mnist-annotation/config_pai.yml
View file @
05913424
...
...
@@ -22,10 +22,6 @@ trial:
memoryMB
:
8196
#The docker image to run nni job on pai
image
:
msranni/nni:latest
#The hdfs directory to store data on pai, format 'hdfs://host:port/directory'
dataDir
:
hdfs://10.10.10.10:9000/username/nni
#The hdfs directory to store output data generated by nni, format 'hdfs://host:port/directory'
outputDir
:
hdfs://10.10.10.10:9000/username/nni
paiConfig
:
#The username to login pai
userName
:
username
...
...
examples/trials/mnist-batch-tune-keras/config_pai.yml
View file @
05913424
...
...
@@ -20,10 +20,6 @@ trial:
memoryMB
:
8196
#The docker image to run nni job on pai
image
:
msranni/nni:latest
#The hdfs directory to store data on pai, format 'hdfs://host:port/directory'
dataDir
:
hdfs://10.10.10.10:9000/username/nni
#The hdfs directory to store output data generated by nni, format 'hdfs://host:port/directory'
outputDir
:
hdfs://10.10.10.10:9000/username/nni
paiConfig
:
#The username to login pai
userName
:
username
...
...
examples/trials/mnist-keras/config_pai.yml
View file @
05913424
...
...
@@ -23,10 +23,6 @@ trial:
memoryMB
:
8196
#The docker image to run nni job on pai
image
:
msranni/nni:latest
#The hdfs directory to store data on pai, format 'hdfs://host:port/directory'
dataDir
:
hdfs://10.10.10.10:9000/username/nni
#The hdfs directory to store output data generated by nni, format 'hdfs://host:port/directory'
outputDir
:
hdfs://10.10.10.10:9000/username/nni
paiConfig
:
#The username to login pai
userName
:
username
...
...
examples/trials/mnist/config_pai.yml
View file @
05913424
...
...
@@ -23,10 +23,6 @@ trial:
memoryMB
:
8196
#The docker image to run nni job on pai
image
:
msranni/nni:latest
#The hdfs directory to store data on pai, format 'hdfs://host:port/directory'
dataDir
:
hdfs://10.10.10.10:9000/username/nni
#The hdfs directory to store output data generated by nni, format 'hdfs://host:port/directory'
outputDir
:
hdfs://10.10.10.10:9000/username/nni
paiConfig
:
#The username to login pai
userName
:
username
...
...
examples/trials/network_morphism/FashionMNIST/config_pai.yml
View file @
05913424
...
...
@@ -30,10 +30,6 @@ trial:
memoryMB
:
8196
#The docker image to run nni job on pai
image
:
msranni/nni:latest
#The hdfs directory to store data on pai, format 'hdfs://host:port/directory'
dataDir
:
hdfs://10.10.10.10:9000/username/nni
#The hdfs directory to store output data generated by nni, format 'hdfs://host:port/directory'
outputDir
:
hdfs://10.10.10.10:9000/username/nni
paiConfig
:
#The username to login pai
userName
:
username
...
...
examples/trials/network_morphism/cifar10/config_pai.yml
View file @
05913424
...
...
@@ -30,10 +30,6 @@ trial:
memoryMB
:
8196
#The docker image to run nni job on pai
image
:
msranni/nni:latest
#The hdfs directory to store data on pai, format 'hdfs://host:port/directory'
dataDir
:
hdfs://10.10.10.10:9000/username/nni
#The hdfs directory to store output data generated by nni, format 'hdfs://host:port/directory'
outputDir
:
hdfs://10.10.10.10:9000/username/nni
paiConfig
:
#The username to login pai
userName
:
username
...
...
examples/trials/sklearn/classification/config_pai.yml
View file @
05913424
...
...
@@ -23,10 +23,6 @@ trial:
memoryMB
:
8196
#The docker image to run nni job on pai
image
:
msranni/nni:latest
#The hdfs directory to store data on pai, format 'hdfs://host:port/directory'
dataDir
:
hdfs://10.10.10.10:9000/username/nni
#The hdfs directory to store output data generated by nni, format 'hdfs://host:port/directory'
outputDir
:
hdfs://10.10.10.10:9000/username/nni
paiConfig
:
#The username to login pai
userName
:
username
...
...
Prev
1
2
3
4
5
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment