GitLab

Updated variable names according to #1193

Our documentation indicates a user with sudo can run the install_prereqs.sh file. Turns out that the file is not complete enough to run on Ubuntu 18.04/20.04 independently. I updated the file to resolve the failures.

resolves #1191

Fuse layernorm and added triadd_layernorm fusion.  This is a prep performance booster

ONNX Models changed from master to main. Changing path reflect the proper location

Expose add_literal method in C/C++ api

Improves performance for add_gelu.  In bert it is 4x faster and for mul_add it is 50% faster than what we current have.

Move to CI containers to rocm 5.0.2
upgrade to 20.04
free up some more file space in github action environments

Add compile tests for gpu math functions

Fixes the #error when using cppcheck. This no longer suppresses cppcheck errors when including those errors. This fixes the cppcheck errors that was there already.