GitLab

Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>

Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>

Co-authored-by: alcanderian <alcanderian@gmail.com>

fix: handle None multimodal_inputs during merging and filtering batches in disaggregation decode mode (#6169)

Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>

Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>

Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>

KV‑Cache (MHA, MLA): add missing start_layer / end_layer fields to MHATokenToKVPoolHost and MLATokenToKVPoolHost (#6016)
Co-authored-by: 继优 <jiyou.ljy@alibaba-inc.com>
Co-authored-by: chus-chus <chus-chus@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

Co-authored-by: xuyongfei.xyf <xuyongfei.xyf@antgroup.com>

Co-authored-by: othame <chenzhu_912@zju.edu.cn>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>

Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Xuting Zhou <xutingz@nvidia.com>
Co-authored-by: ZhengHSI <zhenghsi@qq.com>

Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>