Commits · 39dca6ac4f60877e557264dfc72e9ee4b5c47b3a · gaoqiong / MIGraphX

09 Jun, 2020 1 commit

Embedding bag op (limited support) (#545) · 39dca6ac

kahmed10 authored Jun 09, 2020

* initial progress on embedding_bag

* formatting

* add test

* move enum

* formatting

* fix tidy

* improve test for more coverage

* formatting

* update arg and test

* formatting

* add more tests

* formatting

* fix enum

* formatting

39dca6ac

08 Jun, 2020 1 commit

Enable read support for n-dimensional ops (#537) · cb722cf9

kahmed10 authored Jun 08, 2020



* initial progress

* formatting

* add pooling changes

* formatting

* change eliminate_pad

* formatting

* rename var

* fomratting

* update op shape test and compute

* formatting

* revert conv constructor

* formatting

* change initializer

* formatting

* fix tidy

* change quant conv and shape check

* add tests and fixes

* formatting

* fix type

* fix conv test

* formatting

* add pooling and bn tests

* formatting

* add inconsistent attr tests

* fix padding issue

* formatting

* fix review comments, remove duplicate test

* formatting

* fix variable

* fix assert bug

* fix attr check

* remove std
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

cb722cf9

03 Jun, 2020 1 commit

Bert fuse slice reshape trans contiguous (#542) · 93be5e2b

Shucai Xiao authored Jun 03, 2020



* fix pad calc

* Add decompose pass

* Add decompose test

* Formatting

* bert tf passes correctness

* formatting

* Add remap

* Formatting

* add test

* formatting

* remove comment

* Add compute method for dot

* Formatting

* add inline

* Add finder for horizontal fusion

* Formatting

* Formatting

* Reuse predicate

* formatting

* fix order for literal

* formatting

* add test for gelu

* formatting

* added add_gelu fusion

* Add gemm fusions

* Formatting

* add files

* formatting

* test no mul_add

* formatting

* progress on div

* formatting

* continue work on pass

* remove layernorm opt

* revert reduce file

* Add some fixes for convolution

* Formatting

* Fix shape tests

* Formatting

* Reuse axis equal

* Add initial split fusion

* Formatting

* Update offset

* Workaround outputs that cant accept nonstandard shapes

* Formatting

* Add check for split concat

* Formatting

* Add missing headers

* Formatting

* Add tests

* Formatting

* add optimization for bert

* code backup for bert optimization

* continue testing

* formatting

* fix matcher

* formatting

* add gelu_fn and tests

* formatting

* fix matcher, remove extra tests

* formatting

* fix matcher

* add missing files

* add find_layernorm

* add add_transpose to cmake file

* code backup for the contigous fusion

* refine ops fusion

* clang format

* fixed bug in previous optimization

* clang format

* add more optimization

* remove unnecessary code

* refinement of the fustion code

* clang format

* fixed a bug

* add used_once

* formatting

* start on new gelu

* formatting

* add matchers in fuse_ops

* formatting

* add dce to fix add_gelu

* add simplify_rsqrt and test

* formatting

* debugging value for matcher

* formatting

* add more to matchers

* formatting

* fix errors

* remove onnx gen

* add any_arg, change matchers to use either_arg

* formatting

* clang format

* formatting

* add used_once

* formatting

* code cleanup

* clang format

* fixed a bug

* remove unnecessary code

* refine comments

* optimize bert to remove more contiguous

* clang format

* remove unnecessary code

* add unit tests for bert optimization

* clang format

* fix review comments

* clang format

* refine a fusion of reshape and slice

* clang format

* fix cppcheck error

* fix review comments

* add the fusion of slice and transpose

* clang format

* add another optimization to fuse slice and transpose

* clang format

* fix review comments

* clang format

* fix review comments

* clang format

* fix review comments
Co-authored-by: Khalique <15948690+kahmed10@users.noreply.github.com>
Co-authored-by: Paul <pfultz2@yahoo.com>
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>
Co-authored-by: Shucai Xiao <scxiao@prj47-rack-99.local.lan>

93be5e2b

02 Jun, 2020 2 commits
- Disable cuda compat warning · 7f553e51
  Paul authored Jun 01, 2020
  
  7f553e51
- Merge from master · c6560f37
  Paul authored Jun 01, 2020
  
  c6560f37
29 May, 2020 1 commit
- Fix the usage of move_dpp in HIP-Clang. (#544) · 3124c7f7
  mhbliao authored May 29, 2020
  
  3124c7f7
28 May, 2020 2 commits

Separate gpu unittests to multiple files (#541) · 218e20fc

Shucai Xiao authored May 28, 2020



* code backup

* clang format

* fix compiling errors

* clang format

* rename a few files

* rename a few files

* fix variable bugs

* clang format

* add an operator to shift input sequences

* clang format

* fixed a bug

* clang format

* fixed a bug

* clang format

* code backup

* clang format

* code backup

* clang format

* code backup

* clang format

* refine code related lstm operator optimization

* clang format

* fix various bugs

* clang format

* fixed a bug in rewrite_lstm

* clang format

* fixed another bug

* refine two operator names

* clang format

* refine file names

* fix cppcheck error

* clang format

* fix cppcheck error

* clang format

* fix cppcheck error

* fixed review comments

* clang format

* add unit tests

* clang format

* add unit tests

* clang format

* refine unit tests for better coverage

* clang format

* fixed a bug

* fix cppcheck error

* fix review comments

* clang format

* rename two operators according to review comments

* clang format

* fix review comments

* clang format

* fix review comments

* clang format

* fix review comments

* fix a cppcheck error

* clang format

* fix review comments

* clang format

* add an operator to simplify code

* clang format

* clang format

* fixed a bug and add unit tests

* clang format

* add more unit tests

* clang format

* add more unit tests

* clang format

* add more unit tests

* clang format

* refine a unit test

* clang format

* refine a unit test

* add more unit tests and refine some existing tests for the rnn operator improvements

* clang format

* additional changes to simplify code further

* clang format

* refine a test case to refine cppcheck error

* clang format

* fix cppcheck error

* clang format

* separate rnn tests out to reduce file size

* clang format

* code cleanup

* refine unit tests

* fix clang tidy error

* clang format
Co-authored-by: Shucai Xiao <scxiao@prj47-rack-99.local.lan>
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

218e20fc

Fuse operators that partially match in a concat operator (#539) · 905ebd5e

Paul Fultz II authored May 28, 2020



* Fuse operators that partially match in a concat operator

* Formatting

* Remove unused matcher

* Properly calculate the output_lens

* Formatting

* Formatting

* Formatting

* Fix tidy issue
Co-authored-by: Shucai Xiao <shucai.xiao@amd.com>

905ebd5e

26 May, 2020 1 commit

Add support variable seq lens for the RNN and GRU operators (#535) · d7b8164c

Shucai Xiao authored May 26, 2020



* code backup

* clang format

* fix compiling errors

* clang format

* rename a few files

* rename a few files

* fix variable bugs

* clang format

* add an operator to shift input sequences

* clang format

* fixed a bug

* clang format

* fixed a bug

* clang format

* code backup

* clang format

* code backup

* clang format

* code backup

* clang format

* refine code related lstm operator optimization

* clang format

* fix various bugs

* clang format

* fixed a bug in rewrite_lstm

* clang format

* fixed another bug

* refine two operator names

* clang format

* refine file names

* fix cppcheck error

* clang format

* fix cppcheck error

* clang format

* fix cppcheck error

* fixed review comments

* clang format

* add unit tests

* clang format

* add unit tests

* clang format

* refine unit tests for better coverage

* clang format

* fixed a bug

* fix cppcheck error

* fix review comments

* clang format

* rename two operators according to review comments

* clang format

* fix review comments

* clang format

* fix review comments

* clang format

* fix review comments

* fix a cppcheck error

* clang format

* fix review comments

* clang format

* add an operator to simplify code

* clang format

* clang format

* fixed a bug and add unit tests

* clang format

* add more unit tests

* clang format

* add more unit tests

* clang format

* add more unit tests

* clang format

* refine a unit test

* clang format

* refine a unit test

* add more unit tests and refine some existing tests for the rnn operator improvements

* clang format

* additional changes to simplify code further

* clang format

* refine a test case to refine cppcheck error

* clang format

* fix cppcheck error

* clang format

* add more unit tests

* clang format
Co-authored-by: Shucai Xiao <scxiao@prj47-rack-99.local.lan>
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

d7b8164c

22 May, 2020 2 commits
- Const propogate dot operator (#534) · c41c3501
  Paul Fultz II authored May 22, 2020
```
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>
```
  c41c3501
- Fix rocblas header (#538) · 31b38d12
  Paul Fultz II authored May 22, 2020
  
  31b38d12
21 May, 2020 1 commit

Skip fusing group convolutions (#531) · bfbf0c27

Paul Fultz II authored May 21, 2020



* Skip fusing group convolutions

* Formatting

* Fix ICE on gcc 5

* Formatting

* Fix gcc check

* Formatting
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

bfbf0c27

20 May, 2020 1 commit

Rnn variable seq lengths (#517) · 90200619

Shucai Xiao authored May 19, 2020



* code backup

* clang format

* fix compiling errors

* clang format

* rename a few files

* rename a few files

* fix variable bugs

* clang format

* add an operator to shift input sequences

* clang format

* fixed a bug

* clang format

* fixed a bug

* clang format

* code backup

* clang format

* code backup

* clang format

* code backup

* clang format

* refine code related lstm operator optimization

* clang format

* fix various bugs

* clang format

* fixed a bug in rewrite_lstm

* clang format

* fixed another bug

* refine two operator names

* clang format

* refine file names

* fix cppcheck error

* clang format

* fix cppcheck error

* clang format

* fix cppcheck error

* fixed review comments

* clang format

* add unit tests

* clang format

* add unit tests

* clang format

* refine unit tests for better coverage

* clang format

* fixed a bug

* fix cppcheck error

* fix review comments

* clang format

* rename two operators according to review comments

* clang format

* fix review comments

* clang format

* fix review comments

* clang format

* fix review comments

* fix a cppcheck error

* clang format

* fix review comments

* clang format
Co-authored-by: Shucai Xiao <scxiao@prj47-rack-99.local.lan>
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

90200619

16 May, 2020 1 commit

Add range op (#529) · 369b9f60

kahmed10 authored May 15, 2020



* add range op and test

* add float test

* use generate for vector

* formatting

* fix delta arg check

* fix assert

* formatting
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

369b9f60

15 May, 2020 3 commits

Add gelu optimization (#521) · 0079028a

kahmed10 authored May 15, 2020



* fix pad calc

* bert tf passes correctness

* formatting

* add test

* formatting

* remove comment

* add inline

* formatting

* fix order for literal

* formatting

* add test for gelu

* formatting

* added add_gelu fusion

* add files

* formatting

* remove layernorm opt

* revert reduce file

* add gelu_fn and tests

* formatting

* fix matcher, remove extra tests

* formatting

* fix matcher

* add used_once

* formatting

* start on new gelu

* formatting

* add matchers in fuse_ops

* formatting

* add dce to fix add_gelu

* add simplify_rsqrt and test

* formatting

* debugging value for matcher

* formatting

* add more to matchers

* formatting

* fix errors

* remove onnx gen

* add any_arg, change matchers to use either_arg

* formatting

* formatting

* add used_once

* formatting
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

0079028a

Ensure the slices are in order before removing them in concat (#528) · 294a0e66

Paul Fultz II authored May 15, 2020



* Ensure the slices are in order before removing them in concat

* Formatting
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

294a0e66

Add more constructor to C api for shape (#520) · 557618ba

Paul Fultz II authored May 15, 2020



* Add more constructor to C api for shape

* Formatting

* Fix template file

* Add support for passing null pointers for empy vectors

* Move variable
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

557618ba

14 May, 2020 1 commit

Add reflect pad mode (#515) · 6207ea00

kahmed10 authored May 14, 2020



* add reflect pad and tests

* formatting

* modify iterators

* formatting

* test tidy error

* fix algorithm

* formatting

* rename function

* move conditional

* formatting

* fix test

* fix left pad and tests
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

6207ea00

13 May, 2020 1 commit
- customize the onnx namespace (#526) · dc61b9ae
  Shucai Xiao authored May 13, 2020
```
Co-authored-by: Paul Fultz II <pfultz2@yahoo.com>
```
  dc61b9ae
12 May, 2020 1 commit

cse literal fix (#524) · a54547b3

kahmed10 authored May 12, 2020



* add new test

* formatting

* remove comments

* fix comment and use contains

* formatting
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

a54547b3

11 May, 2020 1 commit

Fix handling of lowest values in pad operator (#514) · 4563b8cd

Paul Fultz II authored May 11, 2020



* Fix handling of lowest values in pad operator

* Formatting

* Formatting

* Formatting

* Add cpu test for lowest padding

* Add test for max
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

4563b8cd

08 May, 2020 1 commit

Horizontal fusions of gemms and convolutions (#472) · 1a4ff504

Paul Fultz II authored May 08, 2020



* Add decompose pass

* Add decompose test

* Formatting

* Add remap

* Formatting

* Add compute method for dot

* Formatting

* Add finder for horizontal fusion

* Formatting

* Formatting

* Reuse predicate

* Add gemm fusions

* Formatting

* Add some fixes for convolution

* Formatting

* Fix shape tests

* Formatting

* Reuse axis equal

* Add initial split fusion

* Formatting

* Update offset

* Workaround outputs that cant accept nonstandard shapes

* Formatting

* Add check for split concat

* Formatting

* Add missing headers

* Formatting

* Add tests

* Formatting

* Add more testing

* Formatting

* Fix when there is duplicate splits in inputs

* Formatting

* Fix mismatch iterators

* Add tests for dot fusions

* Formatting

* Add test for convolution

* Formatting

* Fix tidy issues

* Add more tests

* Formatting

* Ignore build directory for codecov

* Add test for groups

* Formatting

* Add more tests for groups

* Formatting

* Add test for missing end slice

* Add newline

* Remove unused function

* Add support for when beta is not 1

* Formatting

* Add test for scalar

* Add one more scalar test
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

1a4ff504

07 May, 2020 1 commit

Usability updates to onnx parsing (#480) · 45bb91ea

Paul Fultz II authored May 07, 2020



* Add skip unknown operators flag

* Formatting

* Add flag to print program on error

* Formatting

* Fix compile error in py

* Formatting

* Workaround cppcheck error

* Initialize with struct

* Formatting

* Disable warning

* Formatting

* Add test for print errors

* Formatting

* Formatting

* Fix compiler error

* Formatting

* Formatting

* Formatting

* Use correct map

* Formatting
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

45bb91ea

06 May, 2020 1 commit

Add simplify rsqrt pass (#516) · 94addd98

kahmed10 authored May 06, 2020



* add simplify_rsqrt and test

* formatting

* add used_once check

* move used_once

* formatting

* add multi_use test
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

94addd98

05 May, 2020 1 commit

Python_scalar_argument_support (#463) · 233d4303

Shucai Xiao authored May 05, 2020



* python api support scalar argument

* clang format

* add unit test for the scalar type

* clang format

* update to include numpy

* fix package issue

* fix package issue

* fixed review comments

* resolve review comments

* remove unnecessary changes

* refine a unit test for beter coverage

* clang format

* refine unit tests to cover code change

* clang format

* change unit test

* refine tests

* refine unit test

* clang format

* refine unit test

* fix a dockerfile error

* fix bug

* scalar shape support in c++ api

* clang format

* fix cppcheck error

* fix possible errors

* clang format
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

233d4303

04 May, 2020 1 commit
- Add option -fhip-lambda-host-device for HIP-Clang (#518) · caee500e
  Yaxun (Sam) Liu authored May 04, 2020
  
  caee500e
30 Apr, 2020 2 commits

Add tile op (#513) · 9879574a

kahmed10 authored Apr 30, 2020



* fix pad calc

* add tile op

* formatting

* add test

* formatting

* fix tidy

* formatting
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

9879574a

Parse onnx using explicit input shape (#474) · 2074d756

Shucai Xiao authored Apr 29, 2020



* refine slice implementation

* clang format

* fix cppcheck error

* clang format

* change parse operator function signature

* clang format

* add parsing the split operator

* clang format

* add parsing split operator

* make squeeze/unsqueeze inputs to standard shape

* fix a bug in parsing slice

* change parsing pad to support opset 11 definition

* clang format

* add unit tests for the split operator

* clang format

* fix cppcheck error

* clang format

* update tests for multiple program outputs

* clang format

* fix cppcheck error

* clang format

* refine an error message

* add unit tests for the pad operator

* clang format

* add unit tests for slice operator

* clang format

* fix review comments

* fix cppcheck error

* add the numpy package in the Dockerfile

* add c api for onnx options

* clang format

* change c/c++ and python apis related to parse_onnx option change

* clang format

* fixed a bug

* fix a bug

* add fix bugs in cpp api

* fix bugs in c api for onnx_options

* clang format

* add unit tests

* clang format

* add missing onnx file

* add more unit test for dynamic input shape support

* clang format

* fix cppcheck error

* fix cppcheck error

* fix cppcheck error

* clang format

* fix cppcheck error

* clang format

* code change to resolve the segmentation problem

* clang format

* change the api

* clang format

* fixed a unit test error

* fix cppcheck error

* clang format

* fixed a cppcheck error

* fix review comments

* clang format
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

2074d756

29 Apr, 2020 1 commit

Fix bugs in float_equal and add tests (#512) · 1039011a

Paul Fultz II authored Apr 29, 2020



* Fix bugs in float_equal and add tests

* Formatting
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

1039011a

24 Apr, 2020 1 commit

Onehot operator (#510) · 0928c6cb

Shucai Xiao authored Apr 24, 2020

* new onehot implemenation by combining other operators

* clang format

* backup

* update unit tests

* clang format

0928c6cb

21 Apr, 2020 3 commits

Fix build failure for HIP-Clang (#509) · 8aecc1dc
Yaxun (Sam) Liu authored Apr 21, 2020

8aecc1dc

Fix bug in unsqueeze shape and improve test coverage (#495) · f0e530f0

Paul Fultz II authored Apr 21, 2020



* Fix bug in unsqueeze shape and improve test coverage

* Remove else statement

* Revert unsqueeze changes

* Update tests

* Formatting

* Update tests

* Fix handling of scalars

* Add another scalar test
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

f0e530f0

Segment fault c api (#490) · 11bc6104

Shucai Xiao authored Apr 20, 2020



* fixed a bug in the cpp api for the case of zero input parameter

* clang format

* fixed clang format warning
Co-authored-by: Paul Fultz II <pfultz2@yahoo.com>
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

11bc6104

20 Apr, 2020 1 commit

Fix bug in eliminate concat: dont use sorted allocations to assign offsets (#503) · bf6a3507

Paul Fultz II authored Apr 20, 2020



* Fix bug in eliminate concat: dont use sorted allocations to assign offsets

* Formatting
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

bf6a3507

17 Apr, 2020 2 commits

Improve parsing pad operator (#466) · 3bbd808e

Shucai Xiao authored Apr 17, 2020



* change parse operator function signature

* clang format

* add parsing the split operator

* clang format

* add parsing split operator

* make squeeze/unsqueeze inputs to standard shape

* change parsing pad to support opset 11 definition

* clang format

* add unit tests for the split operator

* clang format

* fix cppcheck error

* clang format

* update tests for multiple program outputs

* clang format

* fix cppcheck error

* clang format

* refine an error message

* add unit tests for the pad operator

* clang format

* fix review comments

* fix unit test error
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

3bbd808e

Fix bug with transpose and pad (#497) · 8a89b7f8

Paul Fultz II authored Apr 17, 2020



* Fix bug with transpose and pad

* Formatting
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

8a89b7f8

16 Apr, 2020 2 commits

Make contiguous preserve scalar shape (#500) · dfaab007

Paul Fultz II authored Apr 16, 2020



* Make contiguous preserve scalar shape

* Formatting

* Improve standard shape calulation

* Formatting

* Enable some optimizations on debug build

* Up optimization level

* Remove debug symbols
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

dfaab007

Add OneHot op (#502) · ffde465d

kahmed10 authored Apr 16, 2020



* add onehot and tests, add missing gen_tf for onehot

* formatting

* fix cast

* specify onehot for error msg
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

ffde465d

14 Apr, 2020 1 commit

Small bugs related to rnn (#499) · 10d072b9

Shucai Xiao authored Apr 14, 2020



* code changes for small bugs

* clang format

* remove standard shape requirement for transpose.

* add a unit test

* clang format
Co-authored-by: mvermeulen <5479696+mvermeulen@users.noreply.github.com>

10d072b9

12 Apr, 2020 1 commit
- Use python 3 to install · 394540b1
  Paul authored Apr 12, 2020
  
  394540b1