GitLab

Designed new interface to support reusable training service, currently only applies to OpenPAI, and default disabled.

Replace trial_keeper.py to trial_runner.py, trial_runner holds an environment, and receives commands from nni manager to run or stop an trial, and return events to nni manager.
Add trial dispatcher, which inherits from original trianing service interface. It uses to share as many as possible code of all training service, and isolate with training services.
Add EnvironmentService interface to manage environment, including start/stop an environment, refresh status of environments.
Add command channel on both nni manager and trial runner parts, it supports different ways to pass messages between them. Current supported channels are file, web sockets. and supported commands from nni manager are start, kill trial, send new parameters; from runner are initialized(support some channel doesn't know which runner connected), trial end, stdout ((new type), including metric like before), version check (new type), gpu info (new type).
Add storage service to wrapper a storage to standard file operations, like NFS, azure storage and so on.
Partial support run multiple trials in parallel on runner side, but not supported by trial dispatcher side.
Other minor changes,

Add log_level to TS UT, so that UT can show debug level log.
Expose platform to start info.
Add RouterTrainingService to keep origianl OpenPAI training service, and support dynamic IOC binding.
Add more GPU info for future usage, including GPU mem total/free/used, gpu type.
Make some license information consistence.
Fix async/await problems on Array.forEach, this method doesn't support async actually.
Fix IT errors on download data, which causes by my #2484 .
Accelerate some run loop pattern by reducing sleep seconds.

* Improve docs

* All using # to start

* uploaded -> excluded

* Set versionCheck default to true

* Add .nniignore example

* Rename training service docs

* Update training service docs

* Fix step numbering

* Resolve comments

* Fix typo

* Resolve comments

* Fix broken link

* Adding NAS Benchmark (201)

* Add missing endline

* Update script

* Draft for NAS-Bench-101

* Update NAS-Bench-101

* Update constants

* Add API

* Update API

* Fix typo

* Draft for NDS

* Fix issues in storing loss

* Fix cell_spec problem

* Finalize NDS

* Update time consumption

* Add nds query function

* Update documentation for NAS-Bench-101

* Reformat generators

* Add NAS-Bench-201 docs

* Unite constant names

* Update docstring

* Update docstring

* Update rst

* Update scripts

* Add git as dependency

* Apt update

* Update installation scripts

* Fix dependency for pipeline

* Fix NDS script

* Fix NAS-Bench-201 installation

* Add example notebook

* Correct latency dimension

* shortcuts -> query

* Change run -> trial, ComputedStats -> TrialStats

* ipynb needs re-generation

* Fix NAS rst

* Fix documentation and pylint

* Fix pylint

* Add pandoc as dependency

* Update pandoc dependency

* Fix documentation broken link

* fix link

* sync release version
Co-authored-by: Lijiao <15910218274@163.com>

Co-authored-by: liuzhe <zhe.liu@microsoft.com>

* create Dev homepage (#2101)

create dev homepage for lijiao

* Doc homepage (#2102)

update index

* update (#2413)
Co-authored-by: Lijiao <15910218274@163.com>

* Final doc (#2436)

* change font-family Segoe

* update
Co-authored-by: Lijiao <15910218274@163.com>

* chang font-family (#2438)

"Lato", segoe ui, "proxima-nova","Helvetica Neue",Arial,sans-serif

* update index.html (#2441)

* change font-family Segoe

* update
Co-authored-by: Lijiao <15910218274@163.com>

* change font-family Segoe (#2453)
Co-authored-by: Lijiao <15910218274@163.com>

* Update layout.html (#2469)

* change font-family Segoe (#2478)
Co-authored-by: Lijiao <15910218274@163.com>

* Update index.html (#2482)

* add chinese doc link (#2512)

* add chinese doc link

* update
Co-authored-by: Lijiao <15910218274@163.com>

* change link (#2519)
Co-authored-by: Lijiao <15910218274@163.com>

* update release version

* update wechat group QRcode

* update wechat image (#2533)

* update wechat image

* update link
Co-authored-by: Lijiao <15910218274@163.com>

* fix broken link (#2542)
Co-authored-by: Lijiao <15910218274@163.com>
Co-authored-by: Lijiaoa <61399850+Lijiaoa@users.noreply.github.com>
Co-authored-by: Lijiao <15910218274@163.com>

others

1. fix failed curve fitting UTs, due to code changes.
1. move all SDK UTs to tests folder, so that they can be run in default tests.
1. fix some deprecated ut assert function calls.

update development document.

As requirement of #2390 , removed multiphase from WebUI, document, and put all trials flatten on WebUI.

1. The major change is to split trial-jobs to trials in webui, and use parameter id as part of trial id.
2. If multiphase is enabled, the limitation of trial controls job count only, not trials actually.
3. When multiphase enabled, the trial status may not be right. Previous trials in a job will be marked as success, only last trial presents the job's status.
4. multiphase related documents and UX are removed.

minor changes,
1. Update dev document for webui development.

To support Windows node in remote mode, this PR adds a layer of commands (osCommands) to deal difference between Windows and Unix-like OS. To share code, ShellExecutor is added to enrich original SshClient class.

I will implement windows version commands in next phase.

This pattern can be expanded to Local or other platform in future, so I moved related code to common folder for sharing.

Add shell support for ssh connection, so that remote script can be started with user environment.

Minor fixes,

1. Fix gpu_metrics_collector to support pyenv. As pyenv will create one more process, so that original pgrep code always got extra processes, and cannot start gpu_metrics_collector.
2. Fix NASUI failure on dev-install-node-modules, to create subfolder every time.
3. Fix MakeFile to reduce mis-created links, and other minor issues.
4. Add node --watch for nni_manager for better dev experience.