GitLab

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: mgoin <michael@neuralmagic.com>

Signed-off-by: mgoin <michael@neuralmagic.com>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Co-authored-by: Yan Ma <yan.ma@intel.com>

Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Abhilash Majumder <abhilash.majumder@intel.com>
Co-authored-by: Abhilash Majumder <30946547+abhilash1910@users.noreply.github.com>

[WIP][Core][Refactor] move vllm/model_executor/parallel_utils into vllm/distributed and vllm/device_communicators (#3950)

Co-authored-by: Jiang Li <jiang1.li@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>