GitLab

Signed-off-by: Yifan Qiao <yifanqiao@berkeley.edu>
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
(cherry picked from commit 91e4521f)

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
(cherry picked from commit eb474549)

Signed-off-by: SandishKumarHN <sandishkumarhn@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: SandishKumarHN <sandishkumarhn@gmail.com>
(cherry picked from commit 757068dc)

Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
(cherry picked from commit ea7bfde6)

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
(cherry picked from commit 719735d6)

Signed-off-by: haosdent <haosdent@gmail.com>
(cherry picked from commit a08b7733)

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: Stanislav Kirillov <stas@nebius.com>
Co-authored-by: Stanislav Kirillov <stas@nebius.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>

[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: haosdent <haosdent@gmail.com>

Signed-off-by: walterbm <walter.beller.morales@gmail.com>

Signed-off-by: haosdent <haosdent@gmail.com>

Signed-off-by: Bvicii <yizhanhuang2002@gmail.com>

Signed-off-by: Yifan <yzong@redhat.com>

Signed-off-by: NickLucche <nlucches@redhat.com>

Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>

Signed-off-by: Jonas Kuebler <kuebj@amazon.com>

Signed-off-by: jperezde <jperezde@redhat.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

Signed-off-by: Sage Moore <sagmoore@redhat.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>

Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>

Signed-off-by: sfeng33 <4florafeng@gmail.com>

Signed-off-by: jiang1.li <jiang1.li@intel.com>

Signed-off-by: Or Ozeri <oro@il.ibm.com>

Signed-off-by: Bvicii <yizhanhuang2002@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: Divakar Verma <divakar.verma@amd.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Co-authored-by: Zhewen Li <zhewenli@inferact.ai>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>

Signed-off-by: Matej Rojec <64556640+MatejRojec@users.noreply.github.com>

Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>