GitLab

Detect memory layout (B,C,H,W) (stride for C should be 1, if not, fix it)

This ensures that the backwards kernel is fast

putting qy in shared is a little faster

Changing internal memory layout means we can leave code in standard shape and
only change layout external to kernel

fixing bug in quadrature weights for full attention. Adding better unit tests for attention. Cleanup in the cuda code.