GitLab

Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

Co-authored-by: simon-mo <simon.mo@hey.com>

Co-authored-by: Roger Wang <ywang@roblox.com>

Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

[distributed][misc] keep consistent with how pytorch finds libcudart.so (#6346)

Co-authored-by: Zifei Tong <zifeitong@gmail.com>

Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>

Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Travis Johnson <tsjohnso@us.ibm.com>

Signed-off-by: yatta zhang <ytzhang01@foxmail.com>
Signed-off-by: zhangyuntao.dev <zhangyuntao.dev@bytedance.com>
Co-authored-by: zhangyuntao.dev <zhangyuntao.dev@bytedance.com>

[Speculative Decoding] Enabling bonus token in speculative decoding for KV cache based models (#5765)

Signed-off-by: sangjune.park <sangjune.park@navercorp.com>

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

[core][distributed] add zmq fallback for broadcasting large objects (#6183)