GitLab

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: jiang1.li <jiang1.li@intel.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Duyi-Wang <duyi.wang@amd.com>

Signed-off-by: yassha <50112520+yassha@users.noreply.github.com>

Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>

Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>

Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com>

Signed-off-by: 智鸣 <hzm414167@alibaba-inc.com>

Signed-off-by: cdpath <cdpath@outlook.com>

Signed-off-by: sfeng33 <4florafeng@gmail.com>

Signed-off-by: Hongxia Yang <hongxiay.yang@amd.com>

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: hao-aaron <ahao@anyscale.com>

Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>

Signed-off-by: ahao-anyscale <ahao@anyscale.com>

Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

Signed-off-by: sihao.li <sihao.li@intel.com>

Signed-off-by: Thillai Chithambaram <thillaichithambaram.a@gmail.com>

[Bugfix] Fix KV scales inconsistency in fp8 MLA & FlashInfer kv_cache_dtype "auto" leading to gibberish (#37054)
Signed-off-by: Andy Lo <andy@mistral.ai>

Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>

Signed-off-by: Michael Goin <mgoin64@gmail.com>

Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>

Signed-off-by: Philip Ottesen <phiott256@gmail.com>

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>

Signed-off-by: JartX <sagformas@epdcenter.es>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: chengyufang <cnyvfang@outlook.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: Or Ozeri <oro@il.ibm.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: Ubuntu <ubuntu@ip-172-31-43-201.ap-northeast-1.compute.internal>
Signed-off-by: Ronald Xu <ronaldxu@amazon.com>

Signed-off-by: Xin Yang <xyangx@amazon.com>