GitLab

Co-authored-by: ispobock <ispobaoke@gmail.com>

Co-authored-by: alpha-baby <fujianhao1997@qq.com>

Co-authored-by: ispobock <ispobaoke@gmail.com>

[CPU] support the case where num_attention_heads or intermediate_size is not divisible by the TP size (#6771)

Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: VDV1985 <vladdv85@mail.ru>

Co-authored-by: HydraQYH <QYH820@Outlook.com>
Co-authored-by: TianQiLin666666 <1834987979@qq.com>

Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>

Co-authored-by: blzheng <beilei.zheng@intel.com>

Signed-off-by: Tianyu Zhou <albert.zty@antgroup.com>
Co-authored-by: Zilin Zhu <zhuzilinallen@gmail.com>

Co-authored-by: srinarayan-srikanthan <srinarayan.srikanthan@intel.com>

Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: 弋云 <yiyun.wyt@antgroup.com>
Co-authored-by: walker-ai <2398833647@qq.com>

Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>

Co-authored-by: shuaills <shishuaiuoe@gmail.com>
Co-authored-by: Shenggui Li <somerlee.9@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>