GitLab

Currently, MIGRAPHX_TRACE_EVAL=2 prints out the entire output buffer, but this can produce a lot of output. To make it easier to inspect and debug, using MIGRAPHX_TRACE_EVAL=2 now only prints 10 elements from the buffer(the first 5 and last 5) and shows any fp classifications found in the buffer(ie nans, infinity, etc). The previous behavior can still be enabled with MIGRAPHX_TRACE_EVAL=3.

* use the parse_resize to parse the upsample operator

* Enable auto vectorization
* Handle vector types with convert function
* Dont vectorize when it will cause problems with preload

* Add mean op onnx parser and unit tests
* Refactor parse_mean to use add_broadcastable_binary_op

allow nonstd shape for the arg ops, non-standard shapes include broadcast, slice and transpose

Add HardSwish to HardSigmoid parser

HardSwish formula is y = x * HardSigmoid<alpha=1/6, beta=0.5>(x)
HardSigmoid parser sets alpha to 1/6 and adds the mul instruction if op name is HardSwish

Resolves #1062

Add onnx parser for operator GreaterOrEqual

Add onnx parser and unit tests for Softsign

* Add onnx parser and unit test

* Improve handling of generator expressions when getting the flags for hip

Make clip a pointwise op

Add HardSigmoid onnx parser and unit tests
Produces mathematical equivalent to ONNX operator through combination of existing pointwise ops.
Resolves #1028

* Add matcher for conv_bias pointwise
* Add fusion op

Fix bug caused by casting time seed to float

Changed the number of threads in a block from 256 to 128
Increased the max number of blocks in the kernel from 256 to 1M.
For the case that the axis is the last dimension, we removed the computation of index since it is not required.

With these change, we can get about 2x speedup compared to the develop branch for the softmax op used in the BertSquad model.

Fuse last instruction in fuse_pointwise
This is also fixes a bug with using an invalid iterator.

simple variable rename

Fix pointwise compile error with half sqrt