GitLab

Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

[TPU] kv cache update kernel doesn't need to be padded slices to multiple of num_slices_per_block (#22394)
Signed-off-by: Chengji Yao <chengjiyao@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@gmail.com>

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

Signed-off-by: Syed Muhammad Bin Asif <syedmba7@connect.hku.hk>

[Attention] Support multiple attention metadata builders per kv_cache_spec  + proper local attention no hybrid kv cache fix (#21588)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>

[BugFix] Fix triton compile error in `kernel_unified_attention_2/3d` caused by attention sinks (#22368)
Signed-off-by: LucasWilkinson <lwilkinson@neuralmagic.com>

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Hongxia Yang <62075498+hongxiayang@users.noreply.github.com>
Co-authored-by: Minseok Lee <47620120+minseokl@users.noreply.github.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>

Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>

Signed-off-by: mgoin <michael@neuralmagic.com>

Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>

Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>

Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>

Signed-off-by: Yong Hoon Shin <yhshin@meta.com>

Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lu Fang <fanglu@meta.com>

Signed-off-by: hax0r31337 <liulihaocaiqwq@gmail.com>

Signed-off-by: rzou <zou3519@gmail.com>

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>

Signed-off-by: wangli <wangli858794774@gmail.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: Congcong Chen <congcongchen@microsoft.com>

Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: shuw <shuw@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

Signed-off-by: jiang1.li <jiang1.li@intel.com>

Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>

Signed-off-by: Chengji Yao <chengjiyao@google.com>

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

Signed-off-by: Chengji Yao <chengjiyao@google.com>

Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>

[Bugfix][V1][ROCm] Fix AITER Flash Attention Backend (Fix API Break and Local Attention Logic: affecting Llama4) (#19904)
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>