Commits · 006693ed43defb7827ef3a4d1a8b94000b010ca9 · OpenDAS / vllm_cscc

14 Nov, 2025 1 commit

[Attention] Bump FA for removed method (#28429) · 8cc40f89

Matthew Bonanni authored Nov 14, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

8cc40f89

13 Nov, 2025 2 commits

[Hardware][PowerPC] Fix fp16 compilation error for Power in cpu attention... · 86d15bfd

Akash kaothalkar authored Nov 13, 2025


[Hardware][PowerPC] Fix fp16 compilation error for Power in cpu attention backend and bump oneDNN version (#28535)
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>

86d15bfd

[build][cmake]: Bundle static ACL and torch libgomp for CPU extension builds (#28059) · d44fbbab
Radu Salavat authored Nov 12, 2025
```
Signed-off-by: Radu Salavat <radu.salavat@arm.com>
```
d44fbbab

12 Nov, 2025 1 commit
- [CPU] Refactor CPU attention backend (#27954) · 7f829be7
  Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f829be7
10 Nov, 2025 1 commit

[FA/Chore] Bump FA version for FP8 two-level accumulation (#27889) · 9c84ca82

Jonas M. Kübler authored Nov 10, 2025


Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

9c84ca82

08 Nov, 2025 1 commit
- Refactor CPU/GPU extension targets for CMake build (#28026) · d15afc1f
  Abolfazl Shahbazi authored Nov 07, 2025
```
Signed-off-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
```
  d15afc1f
27 Oct, 2025 1 commit
- [cpu][perf] Fix low CPU utilization with VLLM_CPU_OMP_THREADS_BIND on AArch64 (#27415) · a663f6ae
  Fadi Arafeh authored Oct 27, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  a663f6ae
22 Oct, 2025 1 commit
- [MLA] Bump FlashMLA (#27354) · b4fda58a
  Matthew Bonanni authored Oct 22, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  b4fda58a
21 Oct, 2025 2 commits

[Bugfix] fixes the decoding metadata of dense mla's fp8 kvcache. (#27144) · 250fb1b8

Tao He authored Oct 22, 2025


Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>

250fb1b8

[cpu] Dispatch un-quantized linear to oneDNN/ACL by default for AArch64 (#27183) · 163965d1
Fadi Arafeh authored Oct 21, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Michael Yang <Michael.Yang@arm.com>
```
163965d1

18 Oct, 2025 1 commit

[BugFix] Fix failing gemma-3-1b-it test:... · 9f020f4f

Lucas Wilkinson authored Oct 18, 2025


[BugFix] Fix failing gemma-3-1b-it test: `test_lm_eval_accuracy_v1_engine[google/gemma-3-1b-it]` (#27111)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

9f020f4f

15 Oct, 2025 1 commit
- [CI/Build][Bugfix] fix qutlass cmake error when set QUTLASS_SRC_DIR (#26773) · e471d7ca
  zhrrr authored Oct 15, 2025
```
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  e471d7ca
11 Oct, 2025 2 commits
- fix(nix): Allow local oneDNN path to fix vLLM CPU build failure (#26401) · 086609de
  ihb2032 authored Oct 11, 2025
```
Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn>
Signed-off-by: ihb2032 <1355790728@qq.com>
```
  086609de
- [CI/Build] Fix ppc64le CPU build and tests (#22443) · 8f8474fb
  Nishidha Panpaliya authored Oct 11, 2025
```
Signed-off-by: Nishidha Panpaliya <nishidha.panpaliya@partner.ibm.com>
```
  8f8474fb
10 Oct, 2025 1 commit

[Transform] [Quantization] Add QuTLASS support to vLLM (#24440) · 96ad65b7

Roberto L. Castro authored Oct 10, 2025


Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: Andrei Panferov <andrei@panferov.org>
Co-authored-by: Andrei Panferov <andrei@panferov.org>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

96ad65b7

09 Oct, 2025 1 commit
- [Attention][DCP] Support DCP with query length > 1 (MTP) with FA3 (#25049) · 3b736e1c
  Ming Yang authored Oct 09, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  3b736e1c
05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit

[cpu][perf] Accelerate unquantized-linear for AArch64 through oneDNN/ACL and... · 9705fba7

Fadi Arafeh authored Oct 04, 2025


[cpu][perf] Accelerate unquantized-linear for AArch64 through oneDNN/ACL and weight prepack (#25948)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>

9705fba7

02 Oct, 2025 1 commit
- [FA/Chore] Bump vllm-flash-attention (#25537) · 418d111f
  Lucas Wilkinson authored Oct 02, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  418d111f
01 Oct, 2025 2 commits

[NVIDIA] Blackwell Family (#24673) · 5234dc74

Johnny authored Oct 01, 2025


Signed-off-by: Johnny <johnnynuca14@gmail.com>
Signed-off-by: johnnynunez <johnnynuca14@gmail.com>
Signed-off-by: Johnny <johnnync13@gmail.com>
Signed-off-by: Salvatore Cena <cena@cenas.it>
Co-authored-by: Aidyn-A <31858918+Aidyn-A@users.noreply.github.com>
Co-authored-by: Salvatore Cena <cena@cenas.it>

5234dc74

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · b3230e1a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

b3230e1a

30 Sep, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · fa7e254a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

fa7e254a

25 Sep, 2025 1 commit
- [Hardware][RISC-V] Add riscv64 support for vLLM with scalar (#22112) · 1e9a77e0
  chenlang authored Sep 25, 2025
```
Signed-off-by: chenlang <chen.lang5@zte.com.cn>
Co-authored-by: chenlang <10346245@zte.com.cn>
```
  1e9a77e0
24 Sep, 2025 1 commit
- [fix]: add Arm 4bit fused moe support (#23809) · 359d2930
  Nikhil Gupta authored Sep 24, 2025
```
Signed-off-by: Nikhil Gupta <nikhil.gupta2@arm.com>
```
  359d2930
14 Sep, 2025 1 commit
- Force use C++17 globally to avoid compilation error (#24823) · 79cbcab8
  FengjinChen authored Sep 15, 2025
```
Signed-off-by: chenfengjin <1871653365@qq.com>
```
  79cbcab8
04 Sep, 2025 2 commits

[Hardware][Apple-CPU] Disable OneDNN build for Apple Silicon (#24200) · 369a0795
Ignacio Sica authored Sep 04, 2025
```
Signed-off-by: ignaciosica <mignacio.sica@gmail.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
369a0795

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

26 Aug, 2025 1 commit
- [Hardware][Mac] Fix the installation fail for Apple Silicon (CPU) (#23565) · b78bed1b
  En Ouyang authored Aug 26, 2025
```
Signed-off-by: oye93 <en.ouyang93@outlook.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  b78bed1b
22 Aug, 2025 1 commit
- [Kernel] Add FP8 support with FlashMLA backend (#22668) · 19fe1a05
  Matthew Bonanni authored Aug 21, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  19fe1a05
21 Aug, 2025 1 commit
- [CPU] Refactor CPU W8A8 scaled_mm (#23071) · 7be5d113
  Li, Jiang authored Aug 21, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7be5d113
17 Aug, 2025 1 commit
- [BugFix] Fix for IMA in FA3 varlen combine (#22967) · 292084e7
  Lucas Wilkinson authored Aug 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  292084e7
15 Aug, 2025 1 commit
- [Attention] FA3 Attention Sinks Perf Boost (#22478) · 177e55e3
  Lucas Wilkinson authored Aug 15, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  177e55e3
08 Aug, 2025 2 commits

[Bugfix] Update FA commit hash (#22546) · bd875d2e
Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
bd875d2e

[BugFix] Fix IMA FlashMLA full cuda-graph and DP + Update FlashMLA (#21691) · cd9b9de1

Lucas Wilkinson authored Aug 08, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

cd9b9de1

06 Aug, 2025 3 commits
- [BugFix] Fix FA2 RuntimeError when sinks is provided (#22365) · 2cb6ef89
  Lucas Wilkinson authored Aug 06, 2025
```
Signed-off-by: LucasWilkinson <lwilkinson@neuralmagic.com>
```
  2cb6ef89
- Upgrade FA3 for attention sink (#22313) · e3c876dc
  Woosuk Kwon authored Aug 05, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e3c876dc
- [Bugfix][CI/Build][ROCm] Make sure to use the headers from the build folder on ROCm (#22264) · 5d5d419c
  Gregory Shtrasberg authored Aug 05, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  5d5d419c
25 Jul, 2025 1 commit
- [CI/Build] fix cpu_extension for apple silicon (#21195) · 5140f54b
  Ignacio Sica authored Jul 25, 2025
```
Signed-off-by: ignaciosica <mignacio.sica@gmail.com>
```
  5140f54b
10 Jul, 2025 1 commit
- [Hardware][CPU] Vllm int8 quantization enablement for ARM CPU (#14129) · c7753a98
  nishith-fujitsu authored Jul 10, 2025
```
Signed-off-by: nishith-fujitsu <nishith.jaiswal@fujitsu.com>
```
  c7753a98
03 Jul, 2025 1 commit
- [CI/Build][CPU] Enable cross compilation in CPU release pipeline (#20423) · 7f036710
  Li, Jiang authored Jul 03, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f036710