README.md 4.54 KB
Newer Older
1
2
3
# Neural Network Intelligence

[![Build Status](https://travis-ci.org/Microsoft/nni.svg?branch=master)](https://travis-ci.org/Microsoft/nni)
Microsoft Open Source's avatar
Microsoft Open Source committed
4

QuanluZhang's avatar
QuanluZhang committed
5
6
NNI (Neural Network Intelligence) is a toolkit to help users run automated machine learning experiments. 
The tool dispatches and runs trial jobs that generated by tuning algorithms to search the best neural architecture and/or hyper-parameters in different environments (e.g. local machine, remote servers and cloud).
7
8
9
10
11
12
13

```
            AutoML experiment                                 Training Services
┌────────┐        ┌────────────────────────┐                  ┌────────────────┐
│ nnictl │ ─────> │  nni_manager           │                  │ Local Machine  │
└────────┘        │    sdk/tuner           │                  └────────────────┘
                  │      hyperopt_tuner    │
QuanluZhang's avatar
QuanluZhang committed
14
                  │      evolution_tuner   │    trial jobs    ┌────────────────┐
15
16
17
18
19
20
21
22
23
24
                  │      ...               │     ────────>    │ Remote Servers │          
                  ├────────────────────────┤                  └────────────────┘
                  │  trial job source code │                  
                  │    sdk/annotation      │                  ┌────────────────┐
                  ├────────────────────────┤                  │ Yarn,K8s,      │
                  │  nni_board             │                  │ ...            │
                  └────────────────────────┘                  └────────────────┘
```
## **Who should consider using NNI**
* You want to try different AutoML algorithms for your training code (model) at local
Scarlett Li's avatar
Scarlett Li committed
25
* You want to run AutoML trial jobs in different environments to speed up search (e.g. remote servers and cloud)
26
27
28
* As a researcher and data scientist, you want to implement your own AutoML algorithms and compare with other algorithms
* As a ML platform owner, you want to support AutoML in your platform

Scarlett Li's avatar
Scarlett Li committed
29
# Get Started with NNI
30
31

## **Installation**
Scarlett Li's avatar
Scarlett Li committed
32
33
34
35
36
pip Installation Prerequisites
* linux (ubuntu 16.04 or newer version has been well tested)
* python >= 3.5
* git, wget

37
```
38
python3 -m pip install -v --user git+https://github.com/Microsoft/nni.git@v0.2
39
40
41
source ~/.bashrc
```

Scarlett Li's avatar
Scarlett Li committed
42
43
44
45
46
47
## **Quick start: run your first experiment at local**
It only requires 3 steps to start an experiment on NNI:
![](./docs/3_steps.jpg)


NNI provides a set of examples in the package to get you familiar with the above process. In the following example [/examples/trials/mnist], we had already set up the configuration and updated the training codes for you. You can directly run the following command to start an experiment. 
48

Scarlett Li's avatar
Scarlett Li committed
49
**NOTE**: The following example is an experiment built on TensorFlow, make sure you have **TensorFlow installed** before running the following command.
50

Scarlett Li's avatar
Scarlett Li committed
51
Try it out:
52
```bash
Scarlett Li's avatar
Scarlett Li committed
53
    nnictl create --config ~/nni/examples/trials/mnist/config.yml
54
```
Scarlett Li's avatar
Scarlett Li committed
55
56
57

In the command output, find out the **Web UI url** and open it in your browser. You can analyze your experiment through WebUI, or browse trials' tensorboard. 

Darío Hereñú's avatar
Darío Hereñú committed
58
To learn more about how this example was constructed and how to analyze the experiment results in NNI Web UI, please refer to [How to write a trial run on NNI (MNIST as an example)?](docs/WriteYourTrial.md)
Microsoft Open Source's avatar
Microsoft Open Source committed
59

Scarlett Li's avatar
Scarlett Li committed
60
61
## **Please refer to [Get Started Tutorial](docs/GetStarted.md) for more detailed information.**
## More tutorials
Scarlett Li's avatar
Scarlett Li committed
62

gongwuji's avatar
gongwuji committed
63
64
65
66
67
68
69
70
* [Tutorial of NNI python annotation.](tools/nni_annotation/README.md)
* [Tuners supported by NNI.](src/sdk/pynni/nni/README.md)
* [How to enable early stop (i.e. assessor) in an experiment?](docs/EnableAssessor.md)
* [How to run an experiment on multiple machines?](docs/RemoteMachineMode.md)
* [How to write a customized tuner?](docs/CustomizedTuner.md)
* [How to write a customized assessor?](examples/assessors/README.md)
* [How to resume an experiment?](docs/NNICTLDOC.md)
* [Tutorial of the command tool *nnictl*.](docs/NNICTLDOC.md)
Microsoft Open Source's avatar
Microsoft Open Source committed
71

Scarlett Li's avatar
Scarlett Li committed
72
73
74
75
# Contributing
This project welcomes contributions and suggestions, we are constructing the contribution guidelines, stay tuned =).

We use [GitHub issues](https://github.com/Microsoft/nni/issues) for tracking requests and bugs.
Microsoft Open Source's avatar
Microsoft Open Source committed
76