GitLab

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Signed-off-by: Hissu Hyvarinen <hissu.hyvarinen@amd.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

Signed-off-by: wangshuai09 <391746016@qq.com>

Signed-off-by: wangshuai09 <391746016@qq.com>

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com>

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

Co-authored-by: Simon Mo <simon.mo@hey.com>

Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>

Co-authored-by: Swapnil Parekh <swapnilp@ibm.com>
Co-authored-by: Joe G <joseph.granados@h2o.ai>
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>

Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
Co-authored-by: ZX <zx@lbx.dev>

Co-authored-by: sang <sangcho@anyscale.com>

Signed-off-by: Joe Runde <joe@joerun.de>

Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

[Core][Distributed] add coordinator to reduce code duplication in tp and pp (#5293)