GitLab

* Fix invalid program from find_splits

Change find_mul_conv to work with multibroadcast also. Checks the strides instead of the broadcast axis.

* fix slice_dim1 for case

Using not and or improves readability. The cppcheck rule will help ensure we are doing it consistently.

reshape op requires standard shape. During simplify_algebra, it inserts reshapes without checking for this requirement.

This will rewrite dot operators like X(Y + b) to XY + Xb when b is constant as we can fold the add away.
This improves handling pointwise with broadcasted operators, this helps improves const propagation.
Improve gemm fusion with a mul_add
Improve support for broadcast shapes in gemm

Doing this allows for things to be university across all our targets without neededing an op for each ref.

TODO. breaks right now. Reusing tests from previous iteration with some tweaks. Need to get back to this once I get better train of thought

Conversion works, just issues with predicate right now.

I may need additional checks for this, or to somehow find the matching division
by zero, and cause a dangling reference so this gets flagged correctly at compile time.
Current attempt inserts a divzero instruction that would later get picked up at the verify stage
during compile. Not sure if this is correct incase we run into operator collisions down the road

This reverts commit fcc84214.

Use this call to also skip converts when running a simplify_algebra pass over a program.

Allows us to not throw warnings instead of using [[maybe_unused]] flag instead.

Adds this to handle broadcasted values instead of just scalars

Throw an exception when this occurs to indicate our simpliciation passes resulted in a singularity somewhere. Related to #1236

Simplify addition zero multiplication and divide operations. Added approrpiate test cases with returns and replacing the instruction and operand to just return zero.

Using the unit/neg unit matchers to handle subtraction operations in the same steps. Added unit tests for both cases.

Part of changes that go wtih #1236. Reverts -1 divide operations to a simple negation of the parameter

Add handling for zero addition operations into the find_unit_ops() matcher functor.

Added test case and code to simplify zero additions between paremeters and literals during simplifications.  In reference to issue #1236

Simplfies our code for all operations and reusing original unit tests for overalpping matcher.

Done to satisfy simplifications specified by #1236 .  Just replace every  parameter divided by 1 with itself. It's assumed that the eliminate_identity() pass will handle generated identity operators in our run_pass()

Save a multiply operation with that of a negation of  input parameter x. Suggested improvement via #1236

Commit for the day, work in progress as I'm failing one of our unit tests outside of the change

Updated each source file in the repo with the existing license.

Updated variable names according to #1193

Fuse layernorm and added triadd_layernorm fusion.  This is a prep performance booster

Fixes the #error when using cppcheck. This no longer suppresses cppcheck errors when including those errors. This fixes the cppcheck errors that was there already.

Update the base version of clang-format from 5.0 to 10.0