GitLab

Co-authored-by: Claude <noreply@anthropic.com>

Signed-off-by: Satvik Matta <smatta@nvidia.com>

Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>

Signed-off-by: Graham King <grahamk@nvidia.com>

Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>

Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

feat: enable HTTP completion endpoint to accept arrays of prompts and generate multiple completions per prompt (#3953)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>

Signed-off-by: zhongdaor <zhongdaor@nvidia.com>

Signed-off-by: Graham King <grahamk@nvidia.com>

Signed-off-by: Ryan Lempka <rlempka@nvidia.com>

Signed-off-by: Nicholas Edelman <nedelman@nvidia.com>

Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

Signed-off-by: ayushag <ayushag@nvidia.com>

Signed-off-by: ayushag <ayushag@nvidia.com>

Signed-off-by: ayushag <ayushag@nvidia.com>

Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>

Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>

Signed-off-by: ayushag <ayushag@nvidia.com>

Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: ayushag <ayushag@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>

Signed-off-by: michaelfeil <me@michaelfeil.eu>

Signed-off-by: Michael Feil <63565275+michaelfeil@users.noreply.github.com>
Co-authored-by: Ryan McCormick <mccormick.codes@gmail.com>

Changing the chat completions response objects from structs to types of dynamo_async_openai

Implement aggregator traits for them chat completion structs

add reasoning_content under message and delta message in lib/async-openai

Co-authored-by: Graham King <grahamk@nvidia.com>

feat: Add frontend support for `min_tokens` and `ignore_eos` (outside of `nvext`) and Structured Output / Guided Decoding (#2380)
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>

Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Olga Andreeva <124622579+oandreeva-nv@users.noreply.github.com>

Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>