tutorial_3_tryTunersAndAssessors.md 1.71 KB
Newer Older
Scarlett Li's avatar
Scarlett Li committed
1
# Tutorial - Try different Tuners and Assessors
Scarlett Li's avatar
Scarlett Li committed
2

Scarlett Li's avatar
Scarlett Li committed
3
NNI provides an easy to adopt approach to set up parameter tuning algorithms as well as early stop policies, we call them **Tuners** and **Assessors**.
Scarlett Li's avatar
Scarlett Li committed
4
5
  
**Tuner** specifies the algorithm you use to generate hyperparameter sets for each trial. In NNI, we support two approaches to set the tuner. 
6
1. Directly use tuner provided by NNI sdk
Scarlett Li's avatar
Scarlett Li committed
7
8
9
10
11
12
13
14

        required fields: builtinTunerName and classArgs. 

2. Customize your own tuner file

        required fields: codeDirectory, classFileName, className and classArgs.

### **Learn More about tuners**
Chi Song's avatar
Chi Song committed
15
* For detailed defintion and usage about the required field, please refer to [Config an experiment](ExperimentConfig.md)
xuehui's avatar
xuehui committed
16
* [Tuners in the latest NNI release](HowToChooseTuner.md)
Scarlett Li's avatar
Scarlett Li committed
17
18
19
* [How to implement your own tuner](howto_2_CustomizedTuner.md)


Chi Song's avatar
Chi Song committed
20
**Assessor** specifies the algorithm you use to apply early stop policy. In NNI, there are two approaches to set the assessor.
21
1. Directly use assessor provided by NNI sdk
Scarlett Li's avatar
Scarlett Li committed
22
23
24

        required fields: builtinAssessorName and classArgs. 

Scarlett Li's avatar
Scarlett Li committed
25
2. Customize your own assessor file
Scarlett Li's avatar
Scarlett Li committed
26
27
28
29
30

        required fields: codeDirectory, classFileName, className and classArgs.

### **Learn More about assessor**
* For detailed defintion and usage aobut the required field, please refer to [Config an experiment](ExperimentConfig.md)
Scarlett Li's avatar
Scarlett Li committed
31
* Find more about the detailed instruction about [enable assessor](EnableAssessor.md)
Scarlett Li's avatar
Scarlett Li committed
32
33
34
35
36
37
* [How to implement your own assessor](../examples/assessors/README.md)

## **Learn More**
* [How to run an experiment on local (with multiple GPUs)?](tutorial_1_CR_exp_local_api.md)
* [How to run an experiment on multiple machines?](tutorial_2_RemoteMachineMode.md)
* [How to run an experiment on OpenPAI?](PAIMode.md)