GitLab

feat: enhance GPT OSS frontend with improved harmony tool calling parser and reasoning parser (#2999)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>

Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>

Signed-off-by: Greg Clark <grclark@nvidia.com>

Signed-off-by: Chi McIsaac <chixie.mcisaac@gmail.com>

Signed-off-by: Graham King <grahamk@nvidia.com>

Signed-off-by: Ryan Olson <rolson@nvidia.com>

Signed-off-by: ayushag <ayushag@nvidia.com>

Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: ayushag <ayushag@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>

Signed-off-by: Neal Vaidya <nealv@nvidia.com>

Signed-off-by: Greg Clark <grclark@nvidia.com>

Signed-off-by: Bhuvan Agrawal <11240550+bhuvan002@users.noreply.github.com>

Signed-off-by: Ryan Lempka <rlempka@nvidia.com>

Signed-off-by: Ryan Lempka <rlempka@nvidia.com>

- couple of refactors
- added a new dependency, openai-harmony
- implemented the gpt oss parser

Changing the chat completions response objects from structs to types of dynamo_async_openai

Implement aggregator traits for them chat completion structs

add reasoning_content under message and delta message in lib/async-openai

Co-authored-by: Graham King <grahamk@nvidia.com>

Co-authored-by: Biswa Panda <biswa.panda@gmail.com>

Signed-off-by: Greg Clark <grclark@nvidia.com>

feat: Add frontend support for `min_tokens` and `ignore_eos` (outside of `nvext`) and Structured Output / Guided Decoding (#2380)
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>

Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>