1. 16 Feb, 2024 1 commit
  2. 01 May, 2023 1 commit
    • Nicolas Patry's avatar
      Adding docs on how dynamic batching works. (#258) · e86cca97
      Nicolas Patry authored
      This PR starts the minimal possible amount of explanation I could think
      of. It tries to explain how dynamic batching occurs, the interactions
      with past key values and ignores the padding problem.
      
      Maybe some drawings could help too but I kept it to text for now.
      e86cca97