GitLab

Co-authored-by: Pranjal Shankhdhar <pranjal.ssh@gmail.com>

Co-authored-by: 纬杭 <ximing.wxm@antgroup.com>
Co-authored-by: zyksir <zyksir@outlook.com>

Signed-off-by: Capronir <839972205@qq.com>

Move mem_fraction_static adjustment for multimodal models to `server_args.py` & Fix session control & Other cleanups (#7748)

Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>

Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: zhyncs <me@zhyncs.com>

Co-authored-by: alpha-baby <fujianhao1997@qq.com>

Co-authored-by: ispobock <ispobaoke@gmail.com>

[CPU] support the case where num_attention_heads or intermediate_size is not divisible by the TP size (#6771)

Co-authored-by: Maksim <makcum888e@mail.ru>
Co-authored-by: VDV1985 <vladdv85@mail.ru>

Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>

Co-authored-by: blzheng <beilei.zheng@intel.com>

Signed-off-by: Tianyu Zhou <albert.zty@antgroup.com>
Co-authored-by: Zilin Zhu <zhuzilinallen@gmail.com>

Co-authored-by: srinarayan-srikanthan <srinarayan.srikanthan@intel.com>

Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: HandH1998 <1335248067@qq.com>
Co-authored-by: 弋云 <yiyun.wyt@antgroup.com>
Co-authored-by: walker-ai <2398833647@qq.com>