"tests/vscode:/vscode.git/clone" did not exist on "3d1f2e870a835d9528f35245df7fd98d358647ee"
gemma3: Allow multiple image in a single input
Previously processing multiple images in a batch would trigger segfaults so sending images together was disabled as a way to mitigate this. The trigger was processing one image on the CPU and one on the GPU. This can no longer happen: - The vision encoder is now on the GPU so both images would be processed on the GPU. - We require images to be fully contained in a batch and each image including its special tokens is over half the batch size. As a result, we will never get two images in the same batch. Fixes #9731
Showing
Please register or sign in to comment