GitLab

Signed-off-by: Francesco Fusco <ffu@zurich.ibm.com>

Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

Signed-off-by: Kaihang Jiang <kaihangj@nvidia.com>

Signed-off-by: Santino Ramos <elsantinoramos@gmail.com>

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>

Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>

Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>

Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>

Signed-off-by: tianshu.yu <tianshuyu.formal@gmail.com>

Signed-off-by: Itay Alroy <ialroy@nvidia.com>

Signed-off-by: Divakar Verma <divakar.verma@amd.com>

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>

Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>

Signed-off-by: xueliangyang-oeuler <yxl546827391@gmail.com>
Co-authored-by: xueliangyang-oeuler <yxl546827391@gmail.com>

Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>

Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com>

Signed-off-by: 智鸣 <hzm414167@alibaba-inc.com>

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: hao-aaron <ahao@anyscale.com>

Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
(cherry picked from commit ef2c4f77)

[Bugfix][ROCm] Fix worker startup OOM on ROCm by skipping unreliable cudagraph memory profiling (#36720)
Signed-off-by: JartX <sagformas@epdcenter.es>
(cherry picked from commit e8f9dbc3)

Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>

Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

Signed-off-by: Thillai Chithambaram <thillaichithambaram.a@gmail.com>

[Bugfix] Fix KV scales inconsistency in fp8 MLA & FlashInfer kv_cache_dtype "auto" leading to gibberish (#37054)
Signed-off-by: Andy Lo <andy@mistral.ai>

Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>

Signed-off-by: Philip Ottesen <phiott256@gmail.com>

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: Or Ozeri <oro@il.ibm.com>

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: Itay Alroy <ialroy@nvidia.com>

Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

[Hardware][TPU] Add supports_async_scheduling() method to Executor interface so that it can be extended for Executor implementations. (#36924)
Signed-off-by: Guangxiang Du <gxd@google.com>