GitLab

Signed-off-by: Guan Luo <gluo@nvidia.com>

Signed-off-by: Graham King <grahamk@nvidia.com>

Signed-off-by: Elnifio <elnifio0519@gmail.com>

with `--profile-results-dir use-pre-swept-results`, user doesn't need to run pre-deployment profiling. Dynamo Planner will retrieve pre-swept results in `components/planner/src/dynamo/planner/utils/pre_swept_results` npz folder to generate perf interpolation data points, if the Dynamo Planner configs can be found in the local npz files.

Tested with Dynamo Planner dry run mode: 
```bash
python components/planner/test/planner_sla_dryrun.py \
    --ttft 0.2 \
    --itl 0.01 \
    --adjustment-interval 60 \
    --profile-results-dir use-pre-swept-results \
    --dataset rr-5-45_i3000o300.jsonl \
    --start-num-p 1 \
    --start-num-d 1 \
    --output-plot dryrun_plot.png
```
Signed-off-by: Jason Zhou <jasonzho@nvidia.com>

Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>

Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>

Co-authored-by: Ubuntu <ubuntu@ip-172-31-44-124.ec2.internal>

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>

Signed-off-by: Julien Mancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>

Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>

Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>

Signed-off-by: PeaBrane <yanrpei@gmail.com>

Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>

Signed-off-by: tmontfort <tmontfort@nvidia.com>

Signed-off-by: Gavin.Zhu <gavin.z@gmicloud.ai>

Signed-off-by: Graham King <grahamk@nvidia.com>

Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>

feat: Update docs to indicate need to use consistent hashing for KV events in backend engines (#2981)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>

Signed-off-by: Graham King <grahamk@nvidia.com>

fix: Update the KVBM <> TRT-LLM integration interface to match the latest TRT-LLM connector API (#2979)
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>

Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
Signed-off-by: Tzu-Ling Kan <tzulingk@nvidia.com>

Signed-off-by: Xuwei Li <lixuwei.xy@gmail.com>

Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>

Signed-off-by: Biswa Panda <biswa.panda@gmail.com>

Signed-off-by: Graham King <grahamk@nvidia.com>

Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>

Signed-off-by: ishandhanani <ishandhanani@gmail.com>
Signed-off-by: Elnifio <elnifio0519@gmail.com>
Co-authored-by: Yunzhou Liu <46603306+Elnifio@users.noreply.github.com>

Signed-off-by: Biswa Panda <biswa.panda@gmail.com>

Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>

Signed-off-by: hongkuanz <hongkuanz@nvidia.com>

Signed-off-by: Neal Vaidya <nealv@nvidia.com>

Signed-off-by: Hannah Zhang <hannahz@nvidia.com>

Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>

Signed-off-by: alec-flowers <aflowers@nvidia.com>

Signed-off-by: ayushag <ayushag@nvidia.com>