• Alvaro Bartolome's avatar
    Rollback to `ChatRequest` for Vertex AI Chat instead of `VertexChat` (#2651) · ffe05ccd
    Alvaro Bartolome authored
    As spotted by @philschmid, the payload was compliant with Vertex AI, but
    just partially, since ideally the most compliant version would be with
    the generation kwargs flattened to be on the same level as the
    `messages`; meaning that Vertex AI would still expect a list of
    instances, but each instance would be an OpenAI-compatible instance,
    which is more clear; and more aligned with the SageMaker integration
    too, so kudos to him for spotting that; and sorry from my end for any
    inconvenience @Narsil.
    ffe05ccd
vertex.rs 6 KB