GitLab

Signed-off-by: yiliu30 <yi4.liu@intel.com>

Signed-off-by: SandishKumarHN <sandish@fb.com>

Signed-off-by: Jingu Kang <jg.k@navercorp.com>

Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>

Signed-off-by: ElizaWszola <ewszola@redhat.com>

Signed-off-by: Yintong Lu <yintong.lu@intel.com>

Signed-off-by: SandishKumarHN <sandish@fb.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

Signed-off-by: ilmarkov <markovilya197@gmail.com>

Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: Johnny <johnnynuca14@gmail.com>

Signed-off-by: Roi Koren <roik@nvidia.com>

Signed-off-by: Hongxia Yang <hongxiay.yang@amd.com>
Co-authored-by: Hongxia Yang <hongxiay.yang@amd.com>

Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

Signed-off-by: Tan Pin Siang <pinsiang.tan@amd.com>

Signed-off-by: kangletian <Letian.Kang@amd.com>

Signed-off-by: Jaewon Lee <jaewon@meta.com>

Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>

[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: IriKa Qiu <qiujie.jq@gmail.com>

Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>

Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>

Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
Signed-off-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: Jonas Kuebler <kuebj@amazon.com>

Signed-off-by: Bowen Bao <bowenbao@amd.com>

Signed-off-by: wxsIcey <1790571317@qq.com>
Signed-off-by: Icey <1790571317@qq.com>

Co-authored-by: Zhewen Li <zhewenli@inferact.ai>

Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>

Signed-off-by: BadrBasowid <Badr.Basowid@gmail.com>
Signed-off-by: BadrBasowid <61441185+BadrBasowid@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

Signed-off-by: Jacob Platin <jacobplatin@google.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Matthew Wong <Matthew.Wong2@amd.com>

Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>

[Revert] Remove CUDA torch fallbacks for fp8_mqa_logits/fp8_paged_mqa_logits_torch function (#37968)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: jiang1.li <jiang1.li@intel.com>

Signed-off-by: yewentao256 <zhyanwentao@126.com>