GitLab

Codecov announced deprecating the bash uploader. Using updated uploader

* Remove device functions
* Update tests

This PR allows for other values of epsilon to be matched when finding layernorm. Similarly, the calculation now uses the variable for epsilon.

Change find_mul_conv to work with multibroadcast also. Checks the strides instead of the broadcast axis.

Compute mean and variance in same reduction
Set block size to numbers divisible by 32 instead powers of 2
Global is also set exactly instead of being divisible by block size
More exact matching of global/local can help get rid of branching/loops
Reduce vectors first before doing dpp_reduce
Explicitly vectorize array operators since the compiler doesnt always vectorize them
Still uses old for loop when its computing at compile-time since the reinterpret_cast nor the all the vector types is supported

* fix typo for add_sigmoid

* remove deprecated constructor

* Replaced `find_library` with `find_package` to locate MLIR static library
* Unified the include dir for headers and remove backward compatibility
* Embedded the external/include dir into the exported library

The verify tests from pr #1354 were still causing some codecov timeouts after merge. This PR further reduces the problem sizes to avoid these failures.

* fix slice_dim1 for case

* Implement concat using jit compilation

expose underlying p data inter for migraphx.argument
Update python api documentation

Improves performance for 4/6 GEMMs used by huggingface BERT models with batch_size>1 by using a non-batched rocBLAS call for GEMMs where the B input has a broadcasted batch dimension.
The four verify tests added reflect the actual configurations used by bert-base-cased, with varied batch sizes.

Also adds a matcher to simplify_reshapes to move multibroadcasts after concats.

migraphx version is now 2.4

* Remove unused headers

Fixes TF literal parsing for relu6.  previously always made a float type literal, breaks for float16 as an example

* Fix accuracy bug when vectorizing slices

Using not and or improves readability. The cppcheck rule will help ensure we are doing it consistently.

Rewrite_gelu pass replaces the gelu formula of x * (1/2) * (1 + erf(x/sqrt(2))) with the sigmoid approximation of x * Sigmoid(x * 1.702)

reshape op requires standard shape. During simplify_algebra, it inserts reshapes without checking for this requirement.

* Track kernel time

This will rewrite dot operators like X(Y + b) to XY + Xb when b is constant as we can fold the add away.
This improves handling pointwise with broadcasted operators, this helps improves const propagation.
Improve gemm fusion with a mul_add
Improve support for broadcast shapes in gemm

declare a missing std::size

Has NMS op output a dynamic shape (ONNX spec behavior)
Allows for dynamic input shape to NMS op

* Update is_supported
* Return object from is_supported
* Return by reference in interator

remove print from source

* fix json strings in driver models

Add function argument_from_pointer to allow directly passing a migraphx.shape object and a memory address. 
Expose the is_compiled() method from migraphx::program. 
Expose the enum types under migraphx::op. 

* Horizontally fuse contiguous

Removes unnecessary semi-colon after call to MACRO

Once
https://github.com/ROCmSoftwarePlatform/llvm-project-mlir/pull/690
lands, the ABI for MLIR-generated kernels will change. This commit
prepares MIGraphX for the change by conditionally selecting the new
ABI if MLIR reports a sufficiently high API version in its headers.

Change Dockerfile to use main instead of master for ORT operations

* Allow license_stamper.py to be ran from any directory

* Format
Co-authored-by: kahmed10 <15948690+kahmed10@users.noreply.github.com>