GitLab

Co-authored-by: Yichen Wang <yichen.wang@bytedance.com>
Co-authored-by: Jinwu Guo <641876696@qq.com>

Co-authored-by: yuhyao <827623970@qq.com>

Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>

Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>

Co-authored-by: wanghanpei <wanghanpei@bytedance.com>

Co-authored-by: wanghanpei <wanghanpei@bytedance.com>

Co-authored-by: walker-ai <yiyun.wyt@antgroup.com>
Co-authored-by: leoneo <1320612015@qq.com>

Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>

Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>

Signed-off-by: yangsijia.614 <yangsijia.614@bytedance.com>
Co-authored-by: yicwang <yichen.wang@bytedance.com>

Co-authored-by: ispobock <ispobaoke@gmail.com>

Co-authored-by: HydraQYH <QYH820@Outlook.com>
Co-authored-by: TianQiLin666666 <1834987979@qq.com>

Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: 弋云 <yiyun.wyt@antgroup.com>
Co-authored-by: walker-ai <2398833647@qq.com>

Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>

Co-authored-by: Elfie Guo <elfiegxf@gmail.com>

Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>

Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts fusion is not disabled (#6736)