• Nicolas Patry's avatar
    Adding docs on how dynamic batching works. (#258) · e86cca97
    Nicolas Patry authored
    This PR starts the minimal possible amount of explanation I could think
    of. It tries to explain how dynamic batching occurs, the interactions
    with past key values and ignores the padding problem.
    
    Maybe some drawings could help too but I kept it to text for now.
    e86cca97
README.md 8.07 KB