GitLab

network is allocated on the heap rather than resulting in really large
stack usage for large networks.

tensors with different sizes and it will zero pad them as needed.

define combination layers made out of other combination layers without being
hassled by the compiler.

in-place/out-of-place logic present.

to the range [0,1].

symmetry between the non-inplace version. This also enables additional
optimizations in the resulting network.

since that's a little different in cuDNN.  I also removed my CUDA code for
doing batch normalization and replaced it with cuDNN's new batch normalization
methods.

Finally, I forgot to add a convolutional option to the bn_ object.  Now it has
one so you can set the mode however you like, either BATCH_NORM_FC or
BATCH_NORM_CONV.

it to use the saved average mean and invstd to scale the data instead of
normalizing the batch.

with other parts of the library.

spec says it should.

cudnnAddTensor() function and updated the specs and asserts accordingly.

kernel was still running.

CUDA version of add_bias_gradient().