GitLab

Co-authored-by: zhyncs <me@zhyncs.com>

Co-authored-by: Co-author fzyzcjy <ch271828n@outlook.com>
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
Co-authored-by: zhuofan1123 <zhuofanl@nvidia.com>
Co-authored-by: liz-badada <jinyanc@nvidia.com>
Co-authored-by: xutizhou <xutingz@nvidia.com>
Co-authored-by: linhu-nv <linhu@nvidia.com>

[2/3]  Optimize Slime Update Weights: Avoid GPU-to-CPU Device Sync when update expert weights (#8753)

Co-authored-by: wunhuang <wunhuang@amd.com>

Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>

Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>

Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: YanbingJiang <yanbing.jiang@intel.com>

Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>