GitLab

Co-authored-by: ShenAo1111 <1377693092@qq.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>

Co-authored-by: Chayenne <zhaochen20@outlook.com>

[Fix] use `torch.cat` instead of `torch.concat` to prevent entering the `Autograd` backends. (#4466)

Co-authored-by: HandH1998 <1335248067@qq.com>

Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>

Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

Co-authored-by: sleepcoo <sleepcoo@gmail.com>

Co-authored-by: Wenxuan Tan <wenxuan.tan@wisc.edu>
Co-authored-by: Yineng Zhang <me@zhyncs.com>

Co-authored-by: Chayenne <zhaochen20@outlook.com>