GitLab

[Core][Distributed] refactor pynccl to hold multiple communicators (#4591)

Co-authored-by: Danny Guinther <dguinther@neuralmagic.com>

[Core][Distributed] make init_distributed_environment compatible with init_process_group (#4014)

[WIP][Core][Refactor] move vllm/model_executor/parallel_utils into vllm/distributed and vllm/device_communicators (#3950)

Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Shreyas Krishnaswamy <shrekris@anyscale.com>
Co-authored-by: Avnish Narayan <avnish@anyscale.com>

Co-authored-by: Chen Shen <scv119@gmail.com>
Co-authored-by: Antoni Baum <antoni.baum@protonmail.com>