GitLab

Reworked the simplify_qdq pass to support:

Per-axis quantization (ie. allow 1D scales and zero points)
Allow broadcast and transpose ops between dq and quant_op

Since ONNX opset version 14, layout attribute has been introduced to LSTM operator which allows two predefined layouts for input and output shapes.  Add corresponding reference, onnx, and verify tests.

Remove contiguous from simplify algebra passes for reshape op
Remove contiguous from fuse_pointwise for reshape op

Removes numpy dependency from test_gpu.py test and re-enables Python tests for Python 3.6.

The inaccuracy was caused by ONNX round requires nearest integer rounding for halway (0.5) cases.
std::round rounds away from zero, thus giving wrong results with halfway cases.
Replaced std::round with std::nearbyint which uses the correct rounding by default.

Fixes an issue that comes up for variable input slice with steps set manually in ONNX to default 1's.

Simplifies dimensions_of instructions to a literal when possible.
Intended to be used after the split_single_dyn_dim pass.