GitLab

This PR constitutes the MIGraphX-side changes needed to not break the build in the presence of
ROCmSoftwarePlatform/rocMLIR#1136 , and updates what data is sent in to MLIR during the kernel generation and tuning process.

need to call the script the proper name

onnxruntime is rolling a version with current versions 3.26

This adds a format.py file which will check or apply formatting using git clang-format or yapf.

* add support for rocm 5.6 in CI
* Disable anonymous namespace check
* add default c'tors to avoid warnings

This commit removes the build options to disable threading and removes the mutex in compile_mlir.
The commit being tested is a draft PR on rocMLIR that'll get merged if this passes

Allows the rocMLIR CI (which builds rocMLIR tip against MIGraphX tip) to pass.

Do the following

- Split build_and_test.sh into build_and_install.sh and test_onnxrt_unit_test.py
- Add parity tests to test_onnxrt_parity_tests.sh
- Parallelize unit and parity tests for MIGraphX-Onnxruntime integration in jenkins
- Add changes to dockerfile for additional run scripts.

Idea here is that unit tests take a while, and in the meantime if we perform
a wheel build of onnxruntime library and then run the appropriate parity tests
we should be able to catch any odd changes in parity that are missed by the unit tests
which would also appear in additional testing.

Update `mlir_program` to only create one dialect registry, and to call
registerRocMLIRPasses() (which is needed and may not be thread-safe)
exactly once. 

In addition, use a single thread pool across all contexts. This is
recommended practice upstream for libraries that perform a lot of
compile jobs, and saves on the overhead of creating and destroying a
lot of threads

Add mlir quant_dot operator support

* Update instal_prereqs.sh to handle 22.04 defines

Needed to run containers with 22.04

* Add Dockerfile for Ubuntu 22.04 and ROCm 5.5

Updated dockerfile to use ROCm 5.5 and Ubuntu 22.04 for use with building MIGraphX
Able to run make -j$(nproc) check successfully with this

* Clean this up since its breaking CI

* cleanup install preq some more.

-use one protobuf version
-remove extra python3.8 installs from 3.10 case

* Move comment for protobuf comment

* Move Dockerfile for 22.04 to Dockerfiles/ folder

* Move and rename 2204 docker file

remove Docker_** from the name. Move these to tools/docker

* Add pip3 installs to be shared between python versions

* Add Package pin from repo.radeon.com

* Add CMAKE_ARG ONNX_USE_PROTOBUF_SHARED_LIBS for every default python dist

Set this to be default as part of installing prereqs

---------
Co-authored-by: Charlie Lin <charlie.lin@amd.com>
Co-authored-by: Umang Yadav <29876643+umangyadav@users.noreply.github.com>
Co-authored-by: kahmed10 <15948690+kahmed10@users.noreply.github.com>

Co-authored-by: Sam Wu <sam.wu2@amd.com>
Co-authored-by: Paul <pfultz2@yahoo.com>

Move CI to support the rocm5.5 release

Adds support for slice,transpose,contigous and reshape fusions into input tensors for a fused mlir kernel.

* [MLIR] add dot offloads with manual tuning support
* This commit adds dot + pointwise fusion support
along with manual tuning using rocMLIR.

Enable python 3.10 bindings

Change download location for onnx model from AWS ONNX to download.onnxruntime.ai

upgrade to ROCm 5.4.2 in CI

Fix to use the contents of the .onnxrt-commit file. Docker was not assigning the contents to the dockerfile argument. Changed the technique to be used as part of the git clone download.

* Update MIGraphx Docker to point to latest working onnxrt branch.
* Add output for ONNXRUNTIME_COMMIT in CI and add env var in brackets

Update dialect registration interface
Update 2nd build pipeline call and use full arch name

* Update migraphx docker container to include half and cmake 3.24.2

Upgraded Dockerfiles and fixed tidy issues to make Ubuntu 20.04 and ROCm 5.3.0 the default 

* Enable non-standard shape
* Use perfdb for non xdlops
* Fix transpose+broadcast strides
Co-authored-by: jungpark-mlir <jungwook.park@amd.com>

* Replaced `find_library` with `find_package` to locate MLIR static library
* Unified the include dir for headers and remove backward compatibility
* Embedded the external/include dir into the exported library

Change Dockerfile to use main instead of master for ORT operations

* Add mlir c api

* Formatting

* Create a type attribute

* Formatting

* Parse module

* Formatting

* Add mlir dump function

* Add test case

* Formatting

* Fix tidy issues

* Update mlit version

* Update to newer mlir

* Format

* Move mlir to the gpu and update the test

* Formatting

* Fix bug when appending module

* Format

* Remove old cmake flag

* Update message

* Add return

* Format

* Add mlir_compile

* Format

* Register dialect

* Handle unsinged integers

* Dont provide output for return instruction

* Format

* Add code to insert memrefs

* Format

* Add mlir verification

* Formatting

* Enable pointwise_fusion

* Disable eliminate_data_type

* Set kernal name

* Format

* Fix device name

* Formatting

* Fix output arg

* Format

* Updates

* Upate hash

* Add fuse_mlir pass

* Format

* Add fuse mlir

* Format

* Update mlir

* Sort parameter names

* Format

* Reenable disabled passes

* Remove old mlir conv

* Remove asym default padding

* Add more verbose tracing

* Format

* Fix compilation errors

* Format

* Whitelist operators

* Format

* Add namespace

* Format

* Update triple

* Format

* Use func dialect

* Format

* Use func.return

* Format

* Upgrade mlir version

* Add comment

* Handle symetrical padding

* Format

* Cleanup debug output

* Format

* List failed tests

* Move mlir compile to jit pipeline

* Format

* Update version

* Add source locations

* Format

* Correctly add module

* Format

* Update failed tests

* Fix failures when mlir is disabled

* Format

* Update mlir version

* Check type for fp32

* Format

* Remove failed test

* Update mlir in driver

* Tidy fixes

* Foramt

* Tidy fixes

* Format

* Fix const

* Remove from requirements

* Fix cmake version

* Fix tidy warning

* Use another ifdef

* Fix tidy

* Other tidy fix

* Format

* Update hash

* Add missing license files

* Format

* Format

* Fix fnction name

Move to CI containers to rocm 5.0.2
upgrade to 20.04
free up some more file space in github action environments

Update the base version of clang-format from 5.0 to 10.0

Moving our Docker file from ROCm 4.3 to 4.5 
Add Navi base GPUs in to the CI infrastructure 

* Add rbuild.ini file

* Skip rbuild step

* Use rbuild for gh runners

* Update ini file

* Invalidate cache

* Use full path for ccache

* Use master
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>