@@ -244,8 +244,8 @@ Here is an example of the model configuration, which is passed from the tuner to
...
@@ -244,8 +244,8 @@ Here is an example of the model configuration, which is passed from the tuner to
Every model configuration will has a "layers" section, which is a JSON list of layer definitions. The definition of each layer is also a JSON object, where:
Every model configuration will has a "layers" section, which is a JSON list of layer definitions. The definition of each layer is also a JSON object, where:
*`type` is the type of the layer. 0, 1, 2, 3, 4 corresponde to attention, self-attention, RNN, input and output layer respectively.
*`type` is the type of the layer. 0, 1, 2, 3, 4 correspond to attention, self-attention, RNN, input and output layer respectively.
*`size` is the length of the output. "x", "y" corresponde to document length / question length, respectively.
*`size` is the length of the output. "x", "y" correspond to document length / question length, respectively.
*`input_size` is the number of inputs the layer has.
*`input_size` is the number of inputs the layer has.
*`input` is the indices of layers taken as input of this layer.
*`input` is the indices of layers taken as input of this layer.
*`output` is the indices of layers use this layer's output as their input.
*`output` is the indices of layers use this layer's output as their input.