GitLab

Co-authored-by: guangyey <guangye.yu@intel.com>
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>

Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>

Co-authored-by: hebiao064 <hebiaobuaa@gmail.com>
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>

Signed-off-by: Shangming Cai <csmthu@gmail.com>

Co-authored-by: Maksim <makcum888e@mail.ru>

Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>

Co-authored-by: Zhang Kaihong <zhangkaihong.zkh@alibaba-inc.com>

Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: zxy <zhou0493@e.ntu.edu.sg>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>

Co-authored-by: Li Junwen <lijunwen13@hisilicon.com>

Co-authored-by: Wu, Chunyuan <chunyuan.wu@intel.com>
Co-authored-by: jianan-gu <jianan.gu@intel.com>
Co-authored-by: sdp <sdp@gnr799219.jf.intel.com>

Co-authored-by: 刁莹煜 <diaoyingyu1@hisilicon.com>

Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>

Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>

Co-authored-by: ispobock <ispobaoke@163.com>

Co-authored-by: JieXin Liang <Alcanderian@users.noreply.github.com>

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

Co-authored-by: Zhang Liangang <liangang.zhang@intel.com>