GitLab

[AMD] [Quantization] Add override flag for attention dtype instead of using kv_cache_dtype trigger (#17331)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

Signed-off-by: Bill Nell <bnell@redhat.com>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Signed-off-by: ximing.wxm <ximing.wxm@antgroup.com>
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>

Signed-off-by: mgoin <mgoin64@gmail.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Lu Fang <lufang@fb.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: artetaout <lulala341@gmail.com>

Signed-off-by: Junhao Li <junhao@ubicloud.com>

Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>

Signed-off-by: rzou <zou3519@gmail.com>

Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>

Signed-off-by: py-andy-c <pychen1017@gmail.com>

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

[BugFix][FlashInfer] Fix attention backend interface mismatch with unexpected keyword `use_irope` (#19134)
Signed-off-by: Yunqiu Guo <guorachel@meta.com>

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>

Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>

Signed-off-by: wangli <wangli858794774@gmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

Signed-off-by: Nick Hill <nhill@redhat.com>

Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>

Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>

Signed-off-by: Siyuan Liu <lsiyuan@google.com>

Signed-off-by: Pavani Majety <pmajety@nvidia.com>

Signed-off-by: liusiqian <liusiqian@tal.com>

Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>

Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>

Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

Signed-off-by: Yinghai Lu <yinghai@thinkingmachines.ai>

Signed-off-by: KsuParkhamchuk <k.parkhamchuk@gmail.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: yZhen <yZhen@fb.com>
Co-authored-by: yZhen <yZhen@fb.com>

Signed-off-by: Xu Wenqing <xuwq1993@qq.com>

Signed-off-by: Richard Zou <zou3519@gmail.com>