• Daniël de Kok's avatar
    Support different image sizes in prefill in VLMs (#2065) · e9037708
    Daniël de Kok authored
    When a batch contained images if different sizes during prefill, the
    server would fail (see e.g. #2056). Images were processed separately and
    then concatenated. However, this can fail for images with different sizes.
    
    Fix this by preprocessing all images in the batch together, so that the
    image processor can ensure that all image tensors have compatible sizes.
    e9037708
test_idefics2.py 3.31 KB