GitLab

Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>

Co-authored-by: nanjiangwill <willjiang2018@gmail.com>

Move mem_fraction_static adjustment for multimodal models to `server_args.py` & Fix session control & Other cleanups (#7748)

Co-authored-by: alpha-baby <fujianhao1997@qq.com>

[CPU] support the case where num_attention_heads or intermediate_size is not divisible by the TP size (#6771)

Signed-off-by: Tianyu Zhou <albert.zty@antgroup.com>
Co-authored-by: Zilin Zhu <zhuzilinallen@gmail.com>

Co-authored-by: Kan Wu <wukanustc@gmail.com>

Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: tarinkk <rt572@physics.rutger.edu>
Co-authored-by: tarinkk <rt572@rutgers.physics.edu>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>

Co-authored-by: dangkai.dk <dangkai.dk@alibaba-inc.com>

Co-authored-by: austindeng <austindeng@tencent.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: ch-wan <cwan39@gatech.edu>

Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>

Signed-off-by: huanglong <huanglong@linux.alibaba.com>

Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>

Co-authored-by: austindeng <austindeng@tencent.com>
Co-authored-by: tianqilin.99 <tianqilin.99@bytedance.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: ch-wan <cwan39@gatech.edu>