• Jesse Gross's avatar
    Allow models to force a new batch · 06007c0a
    Jesse Gross authored
    This is useful for a few things:
     - Work around bugs, such as having 2 images in one batch
     - Keep the image in a single batch for fully connected attention
     - Improve performance by not evaluating embeddings multiple times
    06007c0a
input.go 1.21 KB