• Daniël de Kok's avatar
    router: send the input as chunks to the backend · df71aafd
    Daniël de Kok authored
    Before this change, the generation input was sent to the backend as a
    single string, encoding images as Base64 and packing them in
    Markdown-style links.
    
    This change adds a new chunked input representation that separates text
    chunks from images chunks. Image chunks contain binary data (for smaller
    message sizes) and the image's MIME type.
    
    The stringly-typed inputs are still sent to support backends that do not
    support chunked inputs yet.
    df71aafd
queue.rs 20.8 KB