- 06 May, 2023 1 commit
-
-
Chris Austen authored
* Removed split_single_dyn_dim compile flag (#1711) * Update C/C++ API for dynamic batch (#1712) * Python API update for dynamic batch (#1723) * Dynamic batch C++ API example #1728 * Optimize file space of github runners (#1743) Co-authored-by:Charlie Lin <charlie.lin@amd.com>
-
- 10 Apr, 2023 1 commit
-
-
Charlie Lin authored
Adds a matcher to split_single_dyn_dim to find all broadcast or multibroadcast with two static shape inputs and replaces the instruction with the one input version. Sorts the get_output_parameters() list to ensure the correct ordering. (Was getting an error for some models.)
-
- 31 Mar, 2023 1 commit
-
-
Charlie Lin authored
Adds a new GPU compiler pass split_single_dyn_dim that handles when one input parameter has a single non-fixed dynamic_dimension. commonly occurs for dynamic batch or BERT sequence length Splits the dynamic shape into several submodules will static input parameters to handle all of the cases in the dynamic_dimension range. Essentially does what I manually did for the select_module verify tests Adds a compile option split_single_dyn_dim that toggles the pass on/off. Defaults to false. Updates verify_program.hpp and run_verify.cpp to allow for the tests to change the compile_options
-