1. 06 May, 2023 1 commit
    • Chris Austen's avatar
      Rocm56 dynbatch (#1737) · 2e128d9d
      Chris Austen authored
      
      
      * Removed split_single_dyn_dim compile flag (#1711)
      * Update C/C++ API for dynamic batch (#1712)
      * Python API update for dynamic batch (#1723)
      * Dynamic batch C++ API example #1728
      * Optimize file space of github runners (#1743)
      Co-authored-by: default avatarCharlie Lin <charlie.lin@amd.com>
      2e128d9d
  2. 10 Apr, 2023 1 commit
  3. 31 Mar, 2023 1 commit
    • Charlie Lin's avatar
      Split single dynamic dimension compiler pass (#1580) · e9e3eacc
      Charlie Lin authored
      Adds a new GPU compiler pass split_single_dyn_dim that handles when one input parameter has a single non-fixed dynamic_dimension.
      commonly occurs for dynamic batch or BERT sequence length
      Splits the dynamic shape into several submodules will static input parameters to handle all of the cases in the dynamic_dimension range.
      Essentially does what I manually did for the select_module verify tests
      Adds a compile option split_single_dyn_dim that toggles the pass on/off. Defaults to false.
      Updates verify_program.hpp and run_verify.cpp to allow for the tests to change the compile_options
      e9e3eacc