GitLab

Co-authored-by: Michael Goin <michael@neuralmagic.com>

Support pipeline-parallelism with Ray accelerated DAG.
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>

Co-authored-by: Michael Goin <michael@neuralmagic.com>

Signed-off-by: kevin <kevin@anyscale.com>

[build] add ib so that multi-node support with infiniband can be supported out-of-the-box (#6599)

Co-authored-by: Pernekhan Utemuratov <pernekhan@deepinfra.com>

Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>
Co-authored-by: Erez Schwartz <erezs@ai21.com>
Co-authored-by: Mor Zusman <morz@ai21.com>
Co-authored-by: tomeras91 <57313761+tomeras91@users.noreply.github.com>
Co-authored-by: Tomer Asida <tomera@ai21.com>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
Co-authored-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

Signed-off-by: kevin <kevin@anyscale.com>

Signed-off-by: kevin <kevin@anyscale.com>

Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>
Co-authored-by: Roger Wang <ywang@roblox.com>

[CI/Build] fix pip cache with vllm_nccl & refactor dockerfile to build wheels (#3859)