GitLab

Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Julien Mancuso <jmancuso@nvidia.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: ptarasiewiczNV <104908264+ptarasiewiczNV@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>

Co-authored-by: root <root@H20-GPU-24.cm.cluster>

Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>

Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>

Signed-off-by: Fadi Saady <fsaady@nvidia.com>

Co-authored-by: tanmayv25 <tanmay2592@gmail.com>

Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>

Co-authored-by: kkranen <kyle.kranen@gmail.com>

feat: Unnormalize waiting requests + predictive load updates for Python router (mirroring Rust) + softmax sampling to reduce thrashing (#1638)

Signed-off-by: Tanmay Verma <tanmayv@nvidia.com>