nas.rst 1.38 KB
Newer Older
QuanluZhang's avatar
QuanluZhang committed
1
2
3
##########################
Neural Architecture Search
##########################
4
5

Automatic neural architecture search is taking an increasingly important role on finding better models.
QuanluZhang's avatar
QuanluZhang committed
6
7
Recent research works have proved the feasibility of automatic NAS, and also found some models that could beat manually tuned models.
Some of representative works are NASNet, ENAS, DARTS, Network Morphism, and Evolution. Moreover, new innovations keep emerging.
8

QuanluZhang's avatar
QuanluZhang committed
9
However, it takes great efforts to implement NAS algorithms, and it is hard to reuse code base of existing algorithms in a new one.
10
11
12
To facilitate NAS innovations (e.g., design and implement new NAS models, compare different NAS models side-by-side),
an easy-to-use and flexible programming interface is crucial.

QuanluZhang's avatar
QuanluZhang committed
13
Therefore, we provide a unified interface for NAS,
14
15
16
17
to accelerate innovations on NAS, and apply state-of-art algorithms on real world problems faster.
For details, please refer to the following tutorials:

..  toctree::
QuanluZhang's avatar
QuanluZhang committed
18
19
    :maxdepth: 2

20
    Overview <NAS/Overview>
21
22
23
    Write A Search Space <NAS/WriteSearchSpace>
    Classic NAS <NAS/ClassicNas>
    One-shot NAS <NAS/one_shot_nas>
QuanluZhang's avatar
QuanluZhang committed
24
    Retiarii NAS (experimental) <NAS/retiarii/retiarii_index>
Scarlett Li's avatar
Scarlett Li committed
25
    Customize a NAS Algorithm <NAS/Advanced>
26
    NAS Visualization <NAS/Visualization>
27
    Search Space Zoo <NAS/SearchSpaceZoo>
Yuge Zhang's avatar
Yuge Zhang committed
28
    NAS Benchmarks <NAS/Benchmarks>
QuanluZhang's avatar
QuanluZhang committed
29
    API Reference <NAS/NasReference>