Only fuse add with layernorm when its used once (#1529)

This prevents multiple adds.

Only fuse add with layernorm when its used once (#1529)
This prevents multiple adds.
d309e02f · Paul Fultz II · GitHub · 8b651eee · d309e02f
Unverified Commit d309e02f authored Jan 19, 2023 by Paul Fultz II Committed by GitHub Jan 19, 2023
Hide whitespace changes
Inline Side-by-side

Showing with 2 additions and 1 deletion

src/targets/gpu/prefuse_ops.cpp src/targets/gpu/prefuse_ops.cpp +2 -1

No files found.
--- a/src/targets/gpu/prefuse_ops.cpp
+++ b/src/targets/gpu/prefuse_ops.cpp
@@ -100,7 +100,8 @@ struct find_add_layernorm
 {
    auto matcher() const
    {
-        return match::layernorm()(match::var("x")(match::name("add").bind("add")));
+        return match::layernorm()(
+            match::var("x")(match::name("add")(match::used_once()).bind("add")));
    }

    void apply(module& m, const match::matcher_result& r) const