GitLab

feat: Add support for skip_special_tokens parameter in v1/completions and v1/chat/completions endpoints (#4175)

feat: enable HTTP completion endpoint to accept arrays of prompts and generate multiple completions per prompt (#3953)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>

Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>

Signed-off-by: zhongdaor <zhongdaor@nvidia.com>

Signed-off-by: Nicholas Edelman <nedelman@nvidia.com>

Signed-off-by: ayushag <ayushag@nvidia.com>

Signed-off-by: Greg Clark <grclark@nvidia.com>

Signed-off-by: Graham King <grahamk@nvidia.com>

Signed-off-by: ayushag <ayushag@nvidia.com>

Signed-off-by: Ryan Lempka <rlempka@nvidia.com>

Signed-off-by: Ryan Lempka <rlempka@nvidia.com>

Co-authored-by: Graham King <grahamk@nvidia.com>

Signed-off-by: Greg Clark <grclark@nvidia.com>

feat: Add frontend support for `min_tokens` and `ignore_eos` (outside of `nvext`) and Structured Output / Guided Decoding (#2380)
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>

Co-authored-by: Biswa Panda <biswa.panda@gmail.com>

Co-authored-by: Graham King <grahamk@nvidia.com>

Co-authored-by: Graham King <grahamk@nvidia.com>

Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

Signed-off-by: Ryan Olson <ryanolson@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>