GitLab

feat: DIS-323 [trtllm backend publisher] only publish kv event with the biggest window size to support kv routing with variable sliding window attention (#2241)

Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: John Thomson (DLAlgo) <jothomson@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>

Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>

Co-authored-by: Biswa Panda <biswa.panda@gmail.com>

Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>

Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>

Signed-off-by: Ryan McCormick <mccormick.codes@gmail.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>

Signed-off-by: Iman Tabrizian <10105175+Tabrizian@users.noreply.github.com>