• kahmed10's avatar
    Add gelu optimization (#521) · 0079028a
    kahmed10 authored
    
    
    * fix pad calc
    
    * bert tf passes correctness
    
    * formatting
    
    * add test
    
    * formatting
    
    * remove comment
    
    * add inline
    
    * formatting
    
    * fix order for literal
    
    * formatting
    
    * add test for gelu
    
    * formatting
    
    * added add_gelu fusion
    
    * add files
    
    * formatting
    
    * remove layernorm opt
    
    * revert reduce file
    
    * add gelu_fn and tests
    
    * formatting
    
    * fix matcher, remove extra tests
    
    * formatting
    
    * fix matcher
    
    * add used_once
    
    * formatting
    
    * start on new gelu
    
    * formatting
    
    * add matchers in fuse_ops
    
    * formatting
    
    * add dce to fix add_gelu
    
    * add simplify_rsqrt and test
    
    * formatting
    
    * debugging value for matcher
    
    * formatting
    
    * add more to matchers
    
    * formatting
    
    * fix errors
    
    * remove onnx gen
    
    * add any_arg, change matchers to use either_arg
    
    * formatting
    
    * formatting
    
    * add used_once
    
    * formatting
    Co-authored-by: default avatarmvermeulen <5479696+mvermeulen@users.noreply.github.com>
    0079028a
fuse_ops.cpp 23.7 KB