GitLab

Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>

Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>

Signed-off-by: Fadi Saady <fsaady@nvidia.com>

Co-authored-by: tanmayv25 <tanmay2592@gmail.com>

Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>

Co-authored-by: kkranen <kyle.kranen@gmail.com>

feat: Unnormalize waiting requests + predictive load updates for Python router (mirroring Rust) + softmax sampling to reduce thrashing (#1638)

Signed-off-by: Tanmay Verma <tanmayv@nvidia.com>

Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>

Co-authored-by: kkranen <kyle.kranen@gmail.com>

Signed-off-by: Runzhen Wang <wangrunzhen@gmail.com>

Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Signed-off-by: jain-ria <riajain@NVIDIA.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: jain-ria <riajain@NVIDIA.com>