GitLab

Co-authored-by: Graham King <grahamk@nvidia.com>

Signed-off-by: Ryan Olson <rolson@nvidia.com>
Co-authored-by: Olga Andreeva <oandreeva@nvidia.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: John Thompson <jothomson@nvidia.com>
Co-authored-by: Richard Huo <rihuo@nvidia.com>
Co-authored-by: Zicheng Ma <zichengm@nvidia.com>

Signed-off-by: Ryan Olson <ryanolson@users.noreply.github.com>

Co-authored-by: Biswa Panda <biswa.panda@gmail.com>

fix: use tokio spawn / interval.tick(), make nats metric names clearer, fix tests sharing environment variables (temp_env) (#2506)
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

Signed-off-by: nachiketb-nvidia <nachiketb@nvidia.com>

Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

Signed-off-by: jthomson04 <jwillthomson19@gmail.com>

Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>

Signed-off-by: lyang24 <lanqingy93@gmail.com>

Signed-off-by: Greg Clark <grclark@nvidia.com>

Signed-off-by: jthomson04 <jwillthomson19@gmail.com>

Signed-off-by: Dan Aloni <dan.aloni@vastdata.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>

Signed-off-by: jthomson04 <jwillthomson19@gmail.com>

Co-authored-by: krishung5 <krish@nvidia.com>

feat: Add frontend support for `min_tokens` and `ignore_eos` (outside of `nvext`) and Structured Output / Guided Decoding (#2380)
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>

Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>

Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>