Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
nni
Commits
50326948
Unverified
Commit
50326948
authored
Apr 23, 2019
by
SparkSnail
Committed by
GitHub
Apr 23, 2019
Browse files
Merge pull request #165 from Microsoft/master
merge master
parents
5187b2c6
642967b8
Changes
7
Hide whitespace changes
Inline
Side-by-side
Showing
7 changed files
with
130 additions
and
45 deletions
+130
-45
deployment/pypi/README_zh_CN.md
deployment/pypi/README_zh_CN.md
+69
-30
docs/en_US/NNICTLDOC.md
docs/en_US/NNICTLDOC.md
+4
-4
docs/zh_CN/Installation.md
docs/zh_CN/Installation.md
+42
-3
src/sdk/pynni/nni/bohb_advisor/bohb_advisor.py
src/sdk/pynni/nni/bohb_advisor/bohb_advisor.py
+12
-5
src/sdk/pynni/nni/gridsearch_tuner/gridsearch_tuner.py
src/sdk/pynni/nni/gridsearch_tuner/gridsearch_tuner.py
+1
-1
src/sdk/pynni/nni/hyperopt_tuner/hyperopt_tuner.py
src/sdk/pynni/nni/hyperopt_tuner/hyperopt_tuner.py
+1
-1
src/sdk/pynni/nni/metis_tuner/metis_tuner.py
src/sdk/pynni/nni/metis_tuner/metis_tuner.py
+1
-1
No files found.
deployment/pypi/README_zh_CN.md
View file @
50326948
# 用于 NNI 的 python 包索引 (pypi)
# 用于 NNI 的 python 包索引 (pypi)
## 1. 说明
这是用于 NNI 项目的 PyPI 生成和上传的工具。
这是用于 NNI 项目的 PyPI 生成和上传的工具。
## 2.准备环境
## **Linux**
在生成和上传 NNI 包之前,确保使用了下列环境。
Ubuntu 16.04 LTS
*
**准备环境**
make
wget
Python >= 3.5
Pip
Node.js
Yarn
在生成和上传 NNI 包之前,确保使用了下列环境。
Ubuntu 16.04 LTS
make
wget
Python >= 3.5
Pip
Node.js
Yarn
## 2.如何生成
*
**如何生成**
```
bash
```
bash
make
make
```
```
## 3.如何上传
### 上传测试包
```
bash
*
**如何上传**
TWINE_REPOSITORY_URL
=
https://test.pypi.org/legacy/ make upload
```
**上传测试包**
```
bash
TWINE_REPOSITORY_URL
=
https://test.pypi.org/legacy/ make upload
```
上传过程中,可能需要输入 https://test.pypi.org 的用户和密码。
**上传发布包**
```
bash
make upload
```
上传过程中,可能需要输入 https://pypi.org 的用户和密码。
上传过程中,可能需要输入 https://test.pypi.org 的用户和密码。
## **Windows**
### 上传发布包
*
**准备环境**
在生成和上传 NNI 包之前,确保使用了下列环境。
Windows 10
powershell
Python >= 3.5
Pip
Node.js
Yarn
tar
```
bash
*
**如何生成**
make upload
```
```
bash
powershell ./install.ps1
```
上传过程中,可能需要输入 https://pypi.org 的用户和密码。
*
**如何上传**
\ No newline at end of file
**upload for testing**
```
bash
powershell ./upload.ps1
```
上传过程中,可能需要输入 https://test.pypi.org 的用户和密码。
**上传发布包**
```
bash
powershell ./upload.ps1
-test
$False
```
上传过程中,可能需要输入 https://pypi.org 的用户和密码。
\ No newline at end of file
docs/en_US/NNICTLDOC.md
View file @
50326948
...
@@ -167,7 +167,7 @@ Debug mode will disable version check function in Trialkeeper.
...
@@ -167,7 +167,7 @@ Debug mode will disable version check function in Trialkeeper.
`update experiment's new search space with file dir 'examples/trials/mnist/search_space.json'`
`update experiment's new search space with file dir 'examples/trials/mnist/search_space.json'`
```bash
```bash
nnictl update searchspace [experiment_id] --file examples/trials/mnist/search_space.json
nnictl update searchspace [experiment_id] --file
name
examples/trials/mnist/search_space.json
```
```
*
__nnictl update concurrency__
*
__nnictl update concurrency__
...
@@ -388,7 +388,7 @@ Debug mode will disable version check function in Trialkeeper.
...
@@ -388,7 +388,7 @@ Debug mode will disable version check function in Trialkeeper.
|Name, shorthand|Required|Default|Description|
|Name, shorthand|Required|Default|Description|
|------|------|------ |------|
|------|------|------ |------|
|id| False| |ID of the experiment |
|id| False| |ID of the experiment |
|--file| True| |File path of the output file |
|--file
name, -f
| True| |File path of the output file |
|--type| True| |Type of output file, only support "csv" and "json"|
|--type| True| |Type of output file, only support "csv" and "json"|
*
Examples
*
Examples
...
@@ -396,7 +396,7 @@ Debug mode will disable version check function in Trialkeeper.
...
@@ -396,7 +396,7 @@ Debug mode will disable version check function in Trialkeeper.
> export all trial data in an experiment as json format
> export all trial data in an experiment as json format
```
bash
```
bash
nnictl experiment
export
[
experiment_id]
--file
[
file_path]
--type
json
nnictl experiment
export
[
experiment_id]
--file
name
[
file_path]
--type
json
```
```
*
__nnictl experiment import__
*
__nnictl experiment import__
...
@@ -415,7 +415,7 @@ Debug mode will disable version check function in Trialkeeper.
...
@@ -415,7 +415,7 @@ Debug mode will disable version check function in Trialkeeper.
|Name, shorthand|Required|Default|Description|
|Name, shorthand|Required|Default|Description|
|------|------|------|------|
|------|------|------|------|
|id| False| |The id of the experiment you want to import data into|
|id| False| |The id of the experiment you want to import data into|
|--file, -f| True| |a file with data you want to import in json format|
|--file
name
, -f| True| |a file with data you want to import in json format|
*
Details
*
Details
...
...
docs/zh_CN/Installation.md
View file @
50326948
# 安装 NNI
# 安装 NNI
当前
仅
支持 Linux
和 Mac
。
当前支持
在
Linux
,Mac 和 Windows 下安装
。
## **安装**
## **
在 Linux 和 Mac 下
安装**
*
**通过 pip 命令安装 NNI**
*
**通过 pip 命令安装 NNI**
...
@@ -14,7 +14,7 @@
...
@@ -14,7 +14,7 @@
*
**通过源代码安装 NNI**
*
**通过源代码安装 NNI**
先决条件:
`python >=3.5, git, wget`
先决条件:
`python >=3.5
`
,
`
git
`
,
`
wget`
```
bash
```
bash
git clone
-b
v0.6 https://github.com/Microsoft/nni.git
git clone
-b
v0.6 https://github.com/Microsoft/nni.git
...
@@ -26,6 +26,33 @@
...
@@ -26,6 +26,33 @@
也可将 NNI 安装到 docker 映像中。 参考
[
这里
](
../deployment/docker/README.md
)
来生成 NNI 的 Docker 映像。 也可通过此命令从 Docker Hub 中直接拉取 NNI 的映像
`docker pull msranni/nni:latest`
。
也可将 NNI 安装到 docker 映像中。 参考
[
这里
](
../deployment/docker/README.md
)
来生成 NNI 的 Docker 映像。 也可通过此命令从 Docker Hub 中直接拉取 NNI 的映像
`docker pull msranni/nni:latest`
。
## **在 Windows 上安装**
*
**通过 pip 命令安装 NNI**
先决条件:
`python >= 3.5`
```
bash
python
-m
pip
install
--upgrade
nni
```
*
**通过源代码安装 NNI**
先决条件:
`python >=3.5`
,
`git`
,
`powershell`
在第一次使用 PowerShell 时,需要作为管理员运行此命令:
```
bash
Set-ExecutionPolicy
-ExecutionPolicy
Unrestricted
```
然后可以使用管理员或当前用户安装 NNI:
```
bash
git clone https://github.com/Microsoft/nni.git
cd
nni
powershell ./install.ps1
```
## **系统需求**
## **系统需求**
以下是 NNI 在 Linux 下的最低配置。 由于程序变更,NNI 的最低配置会有所更改。
以下是 NNI 在 Linux 下的最低配置。 由于程序变更,NNI 的最低配置会有所更改。
...
@@ -52,6 +79,18 @@
...
@@ -52,6 +79,18 @@
|
**网络**
| 宽带连接 | |
|
**网络**
| 宽带连接 | |
|
**分辨率**
| 1024 x 768 以上 | |
|
**分辨率**
| 1024 x 768 以上 | |
以下是 NNI 在 Windows 下的最低配置。 由于程序变更,NNI 的最低配置会有所更改。
| | 最低配置 | 推荐配置 |
| -------- | ------------------------------------- | ----------------------------------------- |
|
**操作系统**
| Windows 10 | Windows 10 |
|
**CPU**
| Intel® Core™ i3 或 AMD Phenom™ X3 8650 | Intel® Core™ i5 或 AMD Phenom™ II X3 或更高配置 |
|
**GPU**
| NVIDIA® GeForce® GTX 460 | NVIDIA® GeForce® GTX 660 或更高配置 |
|
**内存**
| 4 GB | 6 GB |
|
**存储**
| 30 GB 可用的磁盘空间 | |
|
**网络**
| 宽带连接 | |
|
**分辨率**
| 1024 x 768 以上 | |
## 更多
## 更多
*
[
概述
](
Overview.md
)
*
[
概述
](
Overview.md
)
...
...
src/sdk/pynni/nni/bohb_advisor/bohb_advisor.py
View file @
50326948
...
@@ -589,19 +589,26 @@ class BOHB(MsgDispatcherBase):
...
@@ -589,19 +589,26 @@ class BOHB(MsgDispatcherBase):
"""
"""
_completed_num
=
0
_completed_num
=
0
for
trial_info
in
data
:
for
trial_info
in
data
:
logger
.
info
(
"Importing data, current processing progress %s / %s"
%
(
_completed_num
)
,
len
(
data
))
logger
.
info
(
"Importing data, current processing progress %s / %s"
%
(
_completed_num
,
len
(
data
))
)
_completed_num
+=
1
_completed_num
+=
1
assert
"parameter"
in
trial_info
assert
"parameter"
in
trial_info
_params
=
trial_info
[
"parameter"
]
_params
=
trial_info
[
"parameter"
]
assert
"value"
in
trial_info
assert
"value"
in
trial_info
_value
=
trial_info
[
'value'
]
_value
=
trial_info
[
'value'
]
if
_KEY
not
in
_params
:
budget_exist_flag
=
False
_params
[
_KEY
]
=
self
.
max_budget
barely_params
=
dict
()
for
keys
in
_params
:
if
keys
==
_KEY
:
_budget
=
_params
[
keys
]
budget_exist_flag
=
True
else
:
barely_params
[
keys
]
=
_params
[
keys
]
if
not
budget_exist_flag
:
_budget
=
self
.
max_budget
logger
.
info
(
"Set
\"
TRIAL_BUDGET
\"
value to %s (max budget)"
%
self
.
max_budget
)
logger
.
info
(
"Set
\"
TRIAL_BUDGET
\"
value to %s (max budget)"
%
self
.
max_budget
)
if
self
.
optimize_mode
is
OptimizeMode
.
Maximize
:
if
self
.
optimize_mode
is
OptimizeMode
.
Maximize
:
reward
=
-
_value
reward
=
-
_value
else
:
else
:
reward
=
_value
reward
=
_value
_budget
=
_params
[
_KEY
]
self
.
cg
.
new_result
(
loss
=
reward
,
budget
=
_budget
,
parameters
=
barely_params
,
update_model
=
True
)
self
.
cg
.
new_result
(
loss
=
reward
,
budget
=
_budget
,
parameters
=
_params
,
update_model
=
True
)
logger
.
info
(
"Successfully import tuning data to BOHB advisor."
)
logger
.
info
(
"Successfully import tuning data to BOHB advisor."
)
src/sdk/pynni/nni/gridsearch_tuner/gridsearch_tuner.py
View file @
50326948
...
@@ -160,7 +160,7 @@ class GridSearchTuner(Tuner):
...
@@ -160,7 +160,7 @@ class GridSearchTuner(Tuner):
"""
"""
_completed_num
=
0
_completed_num
=
0
for
trial_info
in
data
:
for
trial_info
in
data
:
logger
.
info
(
"Importing data, current processing progress %s / %s"
%
(
_completed_num
)
,
len
(
data
))
logger
.
info
(
"Importing data, current processing progress %s / %s"
%
(
_completed_num
,
len
(
data
))
)
_completed_num
+=
1
_completed_num
+=
1
assert
"parameter"
in
trial_info
assert
"parameter"
in
trial_info
_params
=
trial_info
[
"parameter"
]
_params
=
trial_info
[
"parameter"
]
...
...
src/sdk/pynni/nni/hyperopt_tuner/hyperopt_tuner.py
View file @
50326948
...
@@ -365,7 +365,7 @@ class HyperoptTuner(Tuner):
...
@@ -365,7 +365,7 @@ class HyperoptTuner(Tuner):
"""
"""
_completed_num
=
0
_completed_num
=
0
for
trial_info
in
data
:
for
trial_info
in
data
:
logger
.
info
(
"Importing data, current processing progress %s / %s"
%
(
_completed_num
)
,
len
(
data
))
logger
.
info
(
"Importing data, current processing progress %s / %s"
%
(
_completed_num
,
len
(
data
))
)
_completed_num
+=
1
_completed_num
+=
1
if
self
.
algorithm_name
==
'random_search'
:
if
self
.
algorithm_name
==
'random_search'
:
return
return
...
...
src/sdk/pynni/nni/metis_tuner/metis_tuner.py
View file @
50326948
...
@@ -411,7 +411,7 @@ class MetisTuner(Tuner):
...
@@ -411,7 +411,7 @@ class MetisTuner(Tuner):
"""
"""
_completed_num
=
0
_completed_num
=
0
for
trial_info
in
data
:
for
trial_info
in
data
:
logger
.
info
(
"Importing data, current processing progress %s / %s"
%
(
_completed_num
)
,
len
(
data
))
logger
.
info
(
"Importing data, current processing progress %s / %s"
%
(
_completed_num
,
len
(
data
))
)
_completed_num
+=
1
_completed_num
+=
1
assert
"parameter"
in
trial_info
assert
"parameter"
in
trial_info
_params
=
trial_info
[
"parameter"
]
_params
=
trial_info
[
"parameter"
]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment