GitLab

Reworked the simplify_qdq pass to support:

Per-axis quantization (ie. allow 1D scales and zero points)
Allow broadcast and transpose ops between dq and quant_op

Since ONNX opset version 14, layout attribute has been introduced to LSTM operator which allows two predefined layouts for input and output shapes.  Add corresponding reference, onnx, and verify tests.

Remove contiguous from simplify algebra passes for reshape op
Remove contiguous from fuse_pointwise for reshape op

The inaccuracy was caused by ONNX round requires nearest integer rounding for halway (0.5) cases.
std::round rounds away from zero, thus giving wrong results with halfway cases.
Replaced std::round with std::nearbyint which uses the correct rounding by default.

Fixes an issue that comes up for variable input slice with steps set manually in ONNX to default 1's.

Simplifies dimensions_of instructions to a literal when possible.
Intended to be used after the split_single_dyn_dim pass.

Since opset version 18, the Split operator allows splitting into unevenly sized outputs when the split input is not present, and a num_outputs attribute has been introduced.

 Add tracing to benchmark to show which kernels are running and the time of every kernel

Adds workarounds to avoid passing capture ops and scalar literals from quantization as arguments to ck_gemm.