1. 19 Sep, 2022 1 commit
    • Paul Fultz II's avatar
      Improve layernorm and reductions performance (#1348) · 97a1ed2d
      Paul Fultz II authored
      Compute mean and variance in same reduction
      Set block size to numbers divisible by 32 instead powers of 2
      Global is also set exactly instead of being divisible by block size
      More exact matching of global/local can help get rid of branching/loops
      Reduce vectors first before doing dpp_reduce
      Explicitly vectorize array operators since the compiler doesnt always vectorize them
      Still uses old for loop when its computing at compile-time since the reinterpret_cast nor the all the vector types is supported
      97a1ed2d
  2. 18 Sep, 2022 2 commits
  3. 17 Sep, 2022 4 commits
  4. 16 Sep, 2022 2 commits
  5. 15 Sep, 2022 6 commits
  6. 14 Sep, 2022 3 commits
  7. 13 Sep, 2022 3 commits
    • turneram's avatar
      Use rocblas_gemm_ex for batched gemms with broadcasted B (#1354) · a10a8ef1
      turneram authored
      Improves performance for 4/6 GEMMs used by huggingface BERT models with batch_size>1 by using a non-batched rocBLAS call for GEMMs where the B input has a broadcasted batch dimension.
      The four verify tests added reflect the actual configurations used by bert-base-cased, with varied batch sizes.
      
      Also adds a matcher to simplify_reshapes to move multibroadcasts after concats.
      a10a8ef1
    • Paul's avatar
      Format · 63db86bd
      Paul authored
      63db86bd
    • Paul's avatar
      Skip group convolution in mlir · 056318a0
      Paul authored
      056318a0
  8. 12 Sep, 2022 5 commits
  9. 10 Sep, 2022 2 commits
  10. 09 Sep, 2022 6 commits
  11. 08 Sep, 2022 2 commits
  12. 07 Sep, 2022 4 commits