GitLab

Signed-off-by: mgoin <mgoin64@gmail.com>

[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets (#18847)

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>

Signed-off-by: mobicham <hicham@mobiuslabs.com>

Signed-off-by: NickLucche <nlucches@redhat.com>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Signed-off-by: Jon Swenson <jmswen@gmail.com>

Signed-off-by: mgoin <mgoin64@gmail.com>

Signed-off-by: Randall Smith <Randall.Smith@amd.com>

Signed-off-by: strutive07 <strutive07@gmail.com>

Signed-off-by: Nick Hill <nhill@redhat.com>

Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>

Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>

Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

Signed-off-by: Andy Xie <andy.xning@gmail.com>

Signed-off-by: rshaw@neuralmagic.com <robertgshaw2@gmail.com>

[AMD] [Quantization] Add override flag for attention dtype instead of using kv_cache_dtype trigger (#17331)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

Signed-off-by: Bill Nell <bnell@redhat.com>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Signed-off-by: ximing.wxm <ximing.wxm@antgroup.com>
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>

Signed-off-by: mgoin <mgoin64@gmail.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Lu Fang <lufang@fb.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: artetaout <lulala341@gmail.com>

Signed-off-by: Junhao Li <junhao@ubicloud.com>

Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>

Signed-off-by: rzou <zou3519@gmail.com>

Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>

Signed-off-by: py-andy-c <pychen1017@gmail.com>

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

[BugFix][FlashInfer] Fix attention backend interface mismatch with unexpected keyword `use_irope` (#19134)
Signed-off-by: Yunqiu Guo <guorachel@meta.com>

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Co-authored-by: Li, Jiang <bigpyj64@gmail.com>

Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>

Signed-off-by: wangli <wangli858794774@gmail.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

Signed-off-by: Nick Hill <nhill@redhat.com>