• Charlie Lin's avatar
    Update C/C++ API for dynamic batch (#1712) · 0ff00ef6
    Charlie Lin authored
    Relies on Removed split_single_dyn_dim compile flag #1711
    Exposes dynamic_dimension as a opaque object with dynamic_dimensions and optimals
    Exposes ONNX dyn_input_dims and default_dyn_dim to run with dynamic batch
    Updates api.py to be able to create objects from aggregate initialization (used for dynamic_dimension)
    Uses offload copy for now
    0ff00ef6
api.cpp 84.1 KB