README.md 1.04 KB
Newer Older
QuanluZhang's avatar
QuanluZhang committed
1
2
3
## Usage

* To test before installing:
Zejun Lin's avatar
Zejun Lin committed
4
`python3 run.py --preinstall`
QuanluZhang's avatar
QuanluZhang committed
5
* To test the integrity of installation:
Zejun Lin's avatar
Zejun Lin committed
6
`python3 run.py`
QuanluZhang's avatar
QuanluZhang committed
7
8
9
10
11
12
13
14
15
16
17
18
19
20
* It will print `PASS` in green eventually if everything works well.

## Details
* This test case tests the communication between trials and tuner/assessor.
* The naive trials receive an integer `x` as parameter, and reports `x`, `x²`, `x³`, ... , `x¹⁰` as metrics.
* The naive tuner simply generates the sequence of natural numbers, and print received metrics to `tuner_result.txt`.
* The naive assessor kills trials when `sum(metrics) % 11 == 1`, and print killed trials to `assessor_result.txt`.
* When tuner and assessor exit with exception, they will append `ERROR` to corresponding result file.
* When the experiment is done, meaning it is successfully done in this case, `Experiment done` can be detected in the nni_manager.log file.

## Issues
* Private APIs are used to detect whether tuner and assessor have terminated successfully. 
* The output of REST server is not tested.
* Remote machine training service is not tested.