GitLab

Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

Co-authored-by: Mor Zusman <morz@ai21.com>

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

Co-authored-by: simon-mo <simon.mo@hey.com>

Co-authored-by: Roger Wang <ywang@roblox.com>

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

Co-authored-by: Zifei Tong <zifeitong@gmail.com>

Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>

Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

[Speculative Decoding] Enabling bonus token in speculative decoding for KV cache based models (#5765)

[core][distributed] add zmq fallback for broadcasting large objects (#6183)

Co-authored-by: Swapnil Parekh <swapnilp@ibm.com>
Co-authored-by: Joe G <joseph.granados@h2o.ai>
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>

[Kernel] Correctly invoke prefill & decode kernels for cross-attention (towards eventual encoder/decoder model support) (#4888)
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

Co-authored-by: Robert Shaw <rshaw@neuralmagic>

Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>