GitLab

Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>

Co-authored-by: wenju.li <wenju.li@deepctr.cn>

Co-authored-by: bppps <zouyu.zzx@alibaba-inc.com>

Co-authored-by: Xinyuan Tong <justinning0323@outlook.com>

Co-authored-by: qingquansong <ustcsqq@gmail.com>

Co-authored-by: Cheng Wan <cwan39@gatech.edu>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@163.com>

Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
Co-authored-by: laixinn <xielx@shanghaitech.edu.cn>

Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>

Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>

Signed-off-by: wangyu <wangyu.steph@bytedance.com>

Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>

Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>

Co-authored-by: root <bjmsong@126.com>