GitLab

[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942)
Co-authored-by: Andrew Feldman <afeld2012@gmail.com>
Co-authored-by: Nick Hill <nickhill@us.ibm.com>

Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

Support pipeline-parallelism with Ray accelerated DAG.
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>

Co-authored-by: youkaichao <youkaichao@126.com>

Co-authored-by: Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

[core][distributed] add zmq fallback for broadcasting large objects (#6183)

Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: ywang96 <ywang@roblox.com>
Co-authored-by: xwjiang2010 <87673679+xwjiang2010@users.noreply.github.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

[ci][distributed] fix some cuda init that makes it necessary to use spawn (#5991)

Co-authored-by: LiuXiaoxuanPKU &lt;llilyliupku@gmail.com&gt;, bong-furiosa <bongwon.jang@furiosa.ai>

Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>

Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>

Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

[Core][Distributed] add coordinator to reduce code duplication in tp and pp (#5293)

[CI/Test] improve robustness of test by replacing del with context manager (vllm_runner) (#5357)