GitLab

Co-authored-by: yhyang201 <yhyang201@gmail.com>

Co-authored-by: root <root@smci350-zts-gtu-e17-15.zts-gtu.dcgpu>

Signed-off-by: Shangming Cai <csmthu@gmail.com>

Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>

Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>

Signed-off-by: Alex Chi <iskyzh@gmail.com>

Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

[Fix] Fix the bug of the calculation of base_gpu_id (dp offset) in data_parallel_controller.py (#10741)

Co-authored-by: svc_repro_tool <svc_repro_tool@habana.ai>

Signed-off-by: Shangming Cai <csmthu@gmail.com>

Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>

Co-authored-by: molocule <34072934+molocule@users.noreply.github.com>

Signed-off-by: Alex Chi Z <iskyzh@gmail.com>