NNICTLDOC.md 10.6 KB
Newer Older
QuanluZhang's avatar
QuanluZhang committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
nnictl
===
## Introduction
__nnictl__ is a command line tool, which can be used to control experiments, such as start/stop/resume an experiment, start/stop NNIBoard, etc.

## Commands
nnictl support commands:
```
nnictl create
nnictl stop
nnictl update
nnictl resume
nnictl trial
nnictl experiment
nnictl config
nnictl log
SparkSnail's avatar
SparkSnail committed
17
nnictl webui
chicm-ms's avatar
chicm-ms committed
18
nnictl tensorboard
SparkSnail's avatar
SparkSnail committed
19
nnictl top
SparkSnail's avatar
SparkSnail committed
20
nnictl --version
QuanluZhang's avatar
QuanluZhang committed
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
```
### Manage an experiment
* __nnictl create__ 
   * Description 
	    
		  You can use this command to create a new experiment, using the configuration specified in config file. 
          After this command is successfully done, the context will be set as this experiment, 
          which means the following command you issued is associated with this experiment, 
          unless you explicitly changes the context(not supported yet). 
   
  * Usage
  
        nnictl create [OPTIONS] 
	  
       Options:  
    
      | Name, shorthand | Required|Default | Description |
      | ------ | ------ | ------ |------ |
goooxu's avatar
goooxu committed
39
      | --config, -c|  True| |yaml configure file of the experiment|
SparkSnail's avatar
SparkSnail committed
40
      | --port, -p  |  False| |the port of restful server| 
QuanluZhang's avatar
QuanluZhang committed
41
42
43
44
45
46
47
48
49
50
51
52
53
54

* __nnictl resume__

  * Description
          
		  You can use this command to resume a stopped experiment.
       
  * Usage
	    
		nnictl resume [OPTIONS] 		
      Options:
     
      | Name, shorthand | Required|Default | Description |
      | ------ | ------ | ------ |------ |
55
56
    | id|  False| |The id of the experiment you want to resume|  
    | --port, -p|  False| |Rest port of the experiment you want to resume|
QuanluZhang's avatar
QuanluZhang committed
57
58
59
60
61
62
63
  
     
      

* __nnictl stop__
  * Description
          
SparkSnail's avatar
SparkSnail committed
64
		You can use this command to stop a running experiment or multiple experiments.
QuanluZhang's avatar
QuanluZhang committed
65
66
67
       
  * Usage
	    	
SparkSnail's avatar
SparkSnail committed
68
69
70
71
72
73
74
75
76
77
        nnictl stop [id]
  
  * Detail
        
        1.If there is an id specified, and the id matches the running experiment, nnictl will stop the corresponding experiment, or will print error message.
        2.If there is no id specified, and there is an experiment running, stop the running experiment, or print error message.
        3.If the id ends with *, nnictl will stop all experiments whose ids matchs the regular.
        4.If the id does not exist but match the prefix of an experiment id, nnictl will stop the matched experiment.
        5.If the id does not exist but match multiple prefix of the experiment ids, nnictl will give id information.
        6.Users could use 'nnictl stop all' to stop all experiments  
QuanluZhang's avatar
QuanluZhang committed
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
     
* __nnictl update__
    
	 * __nnictl update searchspace__
       * Description
          
		     You can use this command to update an experiment's search space.
       
       * Usage
 
              nnictl update searchspace [OPTIONS] 
         
            Options:
        
           | Name, shorthand | Required|Default | Description |
           | ------ | ------ | ------ |------ |
94
         | id|  False| |ID of the experiment you want to set|
QuanluZhang's avatar
QuanluZhang committed
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
         | --filename, -f|  True| |the file storing your new search space|
			
 	* __nnictl update concurrency__  
        * Description
          
		      You can use this command to update an experiment's concurrency.     
	  
	     * Usage
        
		       nnictl update concurrency [OPTIONS] 

            Options:
    
            | Name, shorthand | Required|Default | Description |
            | ------ | ------ | ------ |------ |
110
           | id|  False| |ID of the experiment you want to set|
QuanluZhang's avatar
QuanluZhang committed
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
           | --value, -v|  True| |the number of allowed concurrent trials|
      	
     * __nnictl update duration__  
        * Description
        
               You can use this command to update an experiment's concurrency.  
		
		* Usage
			    	    
			    nnictl update duration [OPTIONS] 

          Options:
    
          | Name, shorthand | Required|Default | Description |
          | ------ | ------ | ------ |------ |
126
127
          | id|  False| |ID of the experiment you want to set|
          | --value, -v|  True| |the experiment duration will be NUMBER seconds. SUFFIX may be 's' for seconds (the default), 'm' for minutes, 'h' for hours or 'd' for days.|  
chicm-ms's avatar
chicm-ms committed
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144

 	* __nnictl update trialnum__  
        * Description
          
		      You can use this command to update an experiment's maxtrialnum.     
	  
	     * Usage
        
		       nnictl update trialnum [OPTIONS] 

            Options:
    
            | Name, shorthand | Required|Default | Description |
            | ------ | ------ | ------ |------ |
           | id|  False| |ID of the experiment you want to set|
           | --value, -v|  True| |the new number of maxtrialnum you want to set|

QuanluZhang's avatar
QuanluZhang committed
145
146
147
148
149
150
151
152
153
154
155
156
     

* __nnictl trial__
  * __nnictl trial ls__
    * Description
          
		    You can use this command to show trial's information.
   
     * Usage
  
           nnictl trial ls

SparkSnail's avatar
SparkSnail committed
157
158
159
160
      Options:
     
      | Name, shorthand | Required|Default | Description |
      | ------ | ------ | ------ |------ |
161
    | id|  False| |ID of the experiment you want to set|
SparkSnail's avatar
SparkSnail committed
162

QuanluZhang's avatar
QuanluZhang committed
163
164
165
166
167
168
169
170
171
172
173
174
  * __nnictl trial kill__
      * Description
            
			You can use this command to kill a trial job.
	   * Usage
  
              nnictl trial kill [OPTIONS] 
    
	      Options:  
	        
          | Name, shorthand | Required|Default | Description |
          | ------ | ------ | ------ |------ |
175
         | id|  False| |ID of the experiment you want to set|   
SparkSnail's avatar
SparkSnail committed
176
         | --trialid, -t|  True| |ID of the trial you want to kill.| 
SparkSnail's avatar
SparkSnail committed
177
178
179
180
181
182
183
184
185
186
  
  * __nnictl top__
    
      * Description
        
        Monitor all of running experiments.
      
      * Usage
  
              nnictl top
QuanluZhang's avatar
QuanluZhang committed
187
      
SparkSnail's avatar
SparkSnail committed
188
189
190
191
192
193
194
      	Options:  
	        
          | Name, shorthand | Required|Default | Description |
          | ------ | ------ | ------ |------ |
         | id|  False| |ID of the experiment you want to set|   
         | --time, -t|  False| |The interval to update the experiment status, the unit of time is second, and the default value is 3 second.| 

QuanluZhang's avatar
QuanluZhang committed
195
196
197
198
199
200
201
202
203
204
205
          

### Manage experiment information

* __nnictl experiment show__
  * Description
      
	     Show the information of experiment.
   * Usage
     
	     nnictl experiment show
SparkSnail's avatar
SparkSnail committed
206
207
208
209
210
    
      Options:
      
        | Name, shorthand | Required|Default | Description |
        | ------ | ------ | ------ |------ |
211
      | id|  False| |ID of the experiment you want to set|
SparkSnail's avatar
SparkSnail committed
212
213
214
215
216
217
218
219
220
221
222
223
224
225


* __nnictl experiment status__
  * Description
      
	     Show the status of experiment.
   * Usage
     
	     nnictl experiment status
      
      Options:
     
      | Name, shorthand | Required|Default | Description |
      | ------ | ------ | ------ |------ |
226
     | id|  False| |ID of the experiment you want to set|
SparkSnail's avatar
SparkSnail committed
227
228
229
230
231


* __nnictl experiment list__
  * Description
      
232
	     Show the information of all the (running) experiments.
SparkSnail's avatar
SparkSnail committed
233
234
235
   * Usage
     
	     nnictl experiment list
QuanluZhang's avatar
QuanluZhang committed
236

237
238
239
240
241
242
      Options:
     
      | Name, shorthand | Required|Default | Description |
      | ------ | ------ | ------ |------ |
     | all|  False| False|Show all of experiments, including stopped experiments.|

QuanluZhang's avatar
QuanluZhang committed
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
 

* __nnictl config show__
    * Description
             
		    Display the current context information.
   
    * Usage
    
	      nnictl config show
        
  
### Manage log
* __nnictl log stdout__
   * Description
     
	     Show the stdout log content. 
   
   * Usage
         
		    nnictl log stdout [options]
        
    	Options:
    	
       | Name, shorthand | Required|Default | Description |
       | ------ | ------ | ------ |------ |
269
     | id|  False| |ID of the experiment you want to set|
QuanluZhang's avatar
QuanluZhang committed
270
271
272
     | --head, -h| False| |show head lines of stdout|
     | --tail, -t|  False| |show tail lines of stdout|
	   | --path, -p|  False| |show the path of stdout file|
273
     
QuanluZhang's avatar
QuanluZhang committed
274
275
276
277
278
279
280
281
282
283
284
285
286
287
	 
* __nnictl log stderr__
  * Description
  
        Show the stderr log content. 
  
  * Usage
  
        nnictl log stderr [options]
        
	   Options:
	   
      | Name, shorthand | Required|Default | Description |
      | ------ | ------ | ------ |------ |
288
    | id|  False| |ID of the experiment you want to set|
QuanluZhang's avatar
QuanluZhang committed
289
290
291
    | --head, -h| False| |show head lines of stderr|
    | --tail, -t|  False| |show tail lines of stderr|
	  | --path, -p|  False| |show the path of stderr file|
292
    
293
294
295
296
297
298
299
300
301
302
303
304
305
306

* __nnictl log trial__
  * Description
  
        Show trial log path. 
  
  * Usage
  
        nnictl log trial [options]
        
	   Options:
	   
      | Name, shorthand | Required|Default | Description |
      | ------ | ------ | ------ |------ |
307
    | id| False| |the id of trial|
SparkSnail's avatar
SparkSnail committed
308
309
310
311
312
313
314
315
316
317
318
319
320
321


### Manage webui
* __nnictl webui url__
   * Description
     
	     Show the urls of the experiment. 
   
   * Usage
         
		    nnictl webui url
        
    	Options:
    	
SparkSnail's avatar
SparkSnail committed
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
       | Name, shorthand | Required|Default | Description |
       | ------ | ------ | ------ |------ |
     | id|  False| |ID of the experiment you want to set|


### Manage tensorboard
* __nnictl tensorboard start__
   * Description
     
	     Start the tensorboard process. 
   
   * Usage
         
		    nnictl tensorboard start
        
    	Options:
    	
       | Name, shorthand | Required|Default | Description |
       | ------ | ------ | ------ |------ |
     | id|  False| |ID of the experiment you want to set|
     | --trialid|  False| |ID of the trial|
     | --port|  False| 6006|The port of the tensorboard process|

   * Detail
     
	     1. NNICTL support tensorboard function in local and remote platform for the moment, other platforms will be supported later.   
         2. If you want to use tensorboard, you need to write your tensorboard log data to environment variable [NNI_OUTPUT_DIR] path.  
         3. In local mode, nnictl will set --logdir=[NNI_OUTPUT_DIR] directly and start a tensorboard process.
         4. In remote mode, nnictl will create a ssh client to copy log data from remote machine to local temp directory firstly, and then start a tensorboard process in your local machine. You need to notice that nnictl only copy the log data one time when you use the command, if you want to see the later result of tensorboard, you should execute nnictl tensorboard command again.
         5. If there is only one trial job, you don't need to set trialid. If there are multiple trial jobs running, you should set the trialid, or you could use [nnictl tensorboard start --trialid all] to map --logdir to all trial log paths.

* __nnictl tensorboard stop__
   * Description
     
	     Stop all of the tensorboard process. 
   
   * Usage
         
		    nnictl tensorboard stop
        
    	Options:
    	
SparkSnail's avatar
SparkSnail committed
364
365
       | Name, shorthand | Required|Default | Description |
       | ------ | ------ | ------ |------ |
SparkSnail's avatar
SparkSnail committed
366
367
368
369
370
371
372
373
374
375
376
377
     | id|  False| |ID of the experiment you want to set|

### Check nni version

* __nnictl --version__
  * Description
    
    Describe the current version of nni installed.
  
  * Usage
    
        nnictl --version