GitLab

Can be enabled via environment variable MIGRAPHX_ENABLE_NHWC

Upgraded Dockerfiles and fixed tidy issues to make Ubuntu 20.04 and ROCm 5.3.0 the default 

This is an extension to insert_module_instructions, but instead of just inserting from a module, it can insert a range or a vector of instructions.

Updated each source file in the repo with the existing license.

Fuse last instruction in fuse_pointwise
This is also fixes a bug with using an invalid iterator.

This enables the pointwise fusions using the MIGRAPHX_ENABLE_POINTWISE_FUSION env variable. Its disabled by default since MIOpen fusions need to be refactored.

This also adds a compile_ops pass to compile the pointwise modules. All tests except test_gpu_fast_math passes with MIGRAPHX_ENABLE_POINTWISE_FUSION=1 set.

Adds a pass to fuse pointwise operators into one "pointwsie" op that has a submodule which does the calculation.