GitLab

Co-authored-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>

[distributed][misc] keep consistent with how pytorch finds libcudart.so (#6346)

[core][distributed] add zmq fallback for broadcasting large objects (#6183)

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>

Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com>

 [Speculative Decoding] Support draft model on different tensor-parallel size than target model (#5414)

Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

[bugfix][distributed] do not error if two processes do not agree on p2p capability (#5612)

Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Abhilash Majumder <abhilash.majumder@intel.com>
Co-authored-by: Abhilash Majumder <30946547+abhilash1910@users.noreply.github.com>

[Core][Distributed] add coordinator to reduce code duplication in tp and pp (#5293)

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

Co-authored-by: Cade Daniel <edacih@gmail.com>
Co-authored-by: Cade Daniel <cade@anyscale.com>