7.txt 1.85 KB
Newer Older
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
   #. For each filter 
      .. image:: http://latex.codecogs.com/gif.latex?F_{i,j}
         :target: http://latex.codecogs.com/gif.latex?F_{i,j}
         :alt: 
      , calculate the sum of its absolute kernel weights
      .. image:: http://latex.codecogs.com/gif.latex?s_j=\sum_{l=1}^{n_i}\sum|K_l|
         :target: http://latex.codecogs.com/gif.latex?s_j=\sum_{l=1}^{n_i}\sum|K_l|
         :alt: 

   #. Sort the filters by 
      .. image:: http://latex.codecogs.com/gif.latex?s_j
         :target: http://latex.codecogs.com/gif.latex?s_j
         :alt: 
      .
   #. Prune 
      .. image:: http://latex.codecogs.com/gif.latex?m
         :target: http://latex.codecogs.com/gif.latex?m
         :alt: 
       filters with the smallest sum values and their corresponding feature maps. The
        kernels in the next convolutional layer corresponding to the pruned feature maps are also
      .. code-block:: bash

         removed.

   #. A new kernel matrix is created for both the 
      .. image:: http://latex.codecogs.com/gif.latex?i
         :target: http://latex.codecogs.com/gif.latex?i
         :alt: 
      th and 
      .. image:: http://latex.codecogs.com/gif.latex?i+1
         :target: http://latex.codecogs.com/gif.latex?i+1
         :alt: 
      th layers, and the remaining kernel
        weights are copied to the new model.
%%%%%%
   #. For each filter :math:`F_{i,j}`, calculate the sum of its absolute kernel weights :math:`s_j=\sum_{l=1}^{n_i}\sum|K_l|`.

   #. Sort the filters by :math:`s_j`.

   #. Prune :math:`m` filters with the smallest sum values and their corresponding feature maps. The
      kernels in the next convolutional layer corresponding to the pruned feature maps are also removed.

   #. A new kernel matrix is created for both the :math:`i`-th and :math:`i+1`-th layers, and the remaining kernel
      weights are copied to the new model.