GitLab

Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>

Signed-off-by: Congcong Chen <congcongchen@microsoft.com>

Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: shuw <shuw@nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

Signed-off-by: jiang1.li <jiang1.li@intel.com>

This reverts commit e202dd27.

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>

Signed-off-by: NickLucche <nlucches@redhat.com>

Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>

Signed-off-by: Andy Xie <andy.xning@gmail.com>

[AMD] [Quantization] Add override flag for attention dtype instead of using kv_cache_dtype trigger (#17331)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

Signed-off-by: Yong Hoon Shin <yhshin@meta.com>

Signed-off-by: simon-mo <simon.mo@hey.com>

Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>

Signed-off-by: LucasWilkinson <lwilkinson@neuralmagic.com>