GitLab

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>

Co-authored-by: HandH1998 <1335248067@qq.com>

Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>

Co-authored-by: Chayenne <zhaochen20@outlook.com>

Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>

Co-authored-by: Ying Sheng <sqy1415@gmail.com>

Co-authored-by: bjmsong <bjmsong@126.com>

Co-authored-by: kavioyu <kavioyu@tencent.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>

Co-authored-by: Chayenne <zhaochen20@outlook.com>

Co-authored-by: Chayenne <zhaochen20@outlook.com>

Co-authored-by: Sangbin <rkooo567@gmail.com>