GitLab

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>

[Core][Distributed] add coordinator to reduce code duplication in tp and pp (#5293)

Signed-off-by: Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai>

[Core][Distributed] refactor pynccl to hold multiple communicators (#4591)

Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

Co-authored-by: Danny Guinther <dguinther@neuralmagic.com>

[Core][Distributed] use existing torch.cuda.device context manager (#4318)

[Core] Add integrity check during initialization; add test for it (#4155)

[WIP][Core][Refactor] move vllm/model_executor/parallel_utils into vllm/distributed and vllm/device_communicators (#3950)

[Core][Test] move local_rank to the last arg with default value to keep api compatible (#3711)