Commits · b3230e1ac0f5c6b46f6c099ef0b3806df8a14feb · OpenDAS / vllm_cscc

01 Oct, 2025 1 commit

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · b3230e1a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

b3230e1a

25 Sep, 2025 1 commit
- [Hardware][RISC-V] Add riscv64 support for vLLM with scalar (#22112) · 1e9a77e0
  chenlang authored Sep 25, 2025
```
Signed-off-by: chenlang <chen.lang5@zte.com.cn>
Co-authored-by: chenlang <10346245@zte.com.cn>
```
  1e9a77e0
24 Sep, 2025 1 commit
- [fix]: add Arm 4bit fused moe support (#23809) · 359d2930
  Nikhil Gupta authored Sep 24, 2025
```
Signed-off-by: Nikhil Gupta <nikhil.gupta2@arm.com>
```
  359d2930
14 Sep, 2025 1 commit
- Force use C++17 globally to avoid compilation error (#24823) · 79cbcab8
  FengjinChen authored Sep 15, 2025
```
Signed-off-by: chenfengjin <1871653365@qq.com>
```
  79cbcab8
04 Sep, 2025 2 commits

[Hardware][Apple-CPU] Disable OneDNN build for Apple Silicon (#24200) · 369a0795
Ignacio Sica authored Sep 04, 2025
```
Signed-off-by: ignaciosica <mignacio.sica@gmail.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
369a0795

[Attention] FlashAttn MLA (#14258) · 402759d4

Lucas Wilkinson authored Sep 04, 2025


Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

402759d4

26 Aug, 2025 1 commit
- [Hardware][Mac] Fix the installation fail for Apple Silicon (CPU) (#23565) · b78bed1b
  En Ouyang authored Aug 26, 2025
```
Signed-off-by: oye93 <en.ouyang93@outlook.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  b78bed1b
22 Aug, 2025 1 commit
- [Kernel] Add FP8 support with FlashMLA backend (#22668) · 19fe1a05
  Matthew Bonanni authored Aug 21, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  19fe1a05
21 Aug, 2025 1 commit
- [CPU] Refactor CPU W8A8 scaled_mm (#23071) · 7be5d113
  Li, Jiang authored Aug 21, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7be5d113
17 Aug, 2025 1 commit
- [BugFix] Fix for IMA in FA3 varlen combine (#22967) · 292084e7
  Lucas Wilkinson authored Aug 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  292084e7
15 Aug, 2025 1 commit
- [Attention] FA3 Attention Sinks Perf Boost (#22478) · 177e55e3
  Lucas Wilkinson authored Aug 15, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  177e55e3
08 Aug, 2025 2 commits

[Bugfix] Update FA commit hash (#22546) · bd875d2e
Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
bd875d2e

[BugFix] Fix IMA FlashMLA full cuda-graph and DP + Update FlashMLA (#21691) · cd9b9de1

Lucas Wilkinson authored Aug 08, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

cd9b9de1

06 Aug, 2025 3 commits
- [BugFix] Fix FA2 RuntimeError when sinks is provided (#22365) · 2cb6ef89
  Lucas Wilkinson authored Aug 06, 2025
```
Signed-off-by: LucasWilkinson <lwilkinson@neuralmagic.com>
```
  2cb6ef89
- Upgrade FA3 for attention sink (#22313) · e3c876dc
  Woosuk Kwon authored Aug 05, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  e3c876dc
- [Bugfix][CI/Build][ROCm] Make sure to use the headers from the build folder on ROCm (#22264) · 5d5d419c
  Gregory Shtrasberg authored Aug 05, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  5d5d419c
25 Jul, 2025 1 commit
- [CI/Build] fix cpu_extension for apple silicon (#21195) · 5140f54b
  Ignacio Sica authored Jul 25, 2025
```
Signed-off-by: ignaciosica <mignacio.sica@gmail.com>
```
  5140f54b
10 Jul, 2025 1 commit
- [Hardware][CPU] Vllm int8 quantization enablement for ARM CPU (#14129) · c7753a98
  nishith-fujitsu authored Jul 10, 2025
```
Signed-off-by: nishith-fujitsu <nishith.jaiswal@fujitsu.com>
```
  c7753a98
03 Jul, 2025 1 commit
- [CI/Build][CPU] Enable cross compilation in CPU release pipeline (#20423) · 7f036710
  Li, Jiang authored Jul 03, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f036710
01 Jul, 2025 2 commits
- [CUDA graphs] Enable full cuda graphs with FA3 AoT scheduling (#20301) · 8acb4bad
  Woosuk Kwon authored Jul 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  8acb4bad
- [CPU] Update custom ops for the CPU backend (#20255) · 6cc1e7d9
  Li, Jiang authored Jul 01, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  6cc1e7d9
29 Jun, 2025 1 commit
- Fix cuda_archs_loose_intersection when handling sm_*a (#20207) · 6c9837a7
  Huy Do authored Jun 29, 2025
```
Signed-off-by: Huy Do <huydhn@gmail.com>
```
  6c9837a7
24 Jun, 2025 2 commits
- cmake: Update vllm_flash_attn for vllm_kernels (#20032) · 0d06b533
  Eli Uriegas authored Jun 24, 2025
```
Signed-off-by: Eli Uriegas <eliuriegas@meta.com>
```
  0d06b533
- [Perf] Improve/Fix-regression for FA3 in High QPS regimes (#19463) · a045b7e8
  Lucas Wilkinson authored Jun 24, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  a045b7e8
19 Jun, 2025 1 commit
- [Misc][ROCm] Enforce no unused variable in ROCm C++ files (#19796) · 8d1e89d9
  Lu Fang authored Jun 19, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  8d1e89d9
17 Jun, 2025 1 commit
- [Wheel Size] Only build FA2 8.0+PTX (#19336) · 07334959
  Lucas Wilkinson authored Jun 16, 2025
  
  07334959
08 Jun, 2025 1 commit
- [Hardware][POWER] Add IBM POWER11 Support to CPU Extension Detection (#19082) · b9a1791e
  Akash kaothalkar authored Jun 08, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
```
  b9a1791e
03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
28 May, 2025 1 commit
- [Build] Fixes for CMake install (#18570) · a3896c7f
  Luka Govedič authored May 27, 2025
  
  a3896c7f
15 May, 2025 1 commit
- [Build] Allow shipping PTX on a per-file basis (#18155) · c7852a6d
  Lucas Wilkinson authored May 15, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  c7852a6d
08 May, 2025 1 commit

[Hardware][Power] Enable compressed tensor W8A8 INT8 quantization for POWER (#17153) · e515668e

Akash kaothalkar authored May 08, 2025


Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

e515668e

25 Apr, 2025 2 commits
- [Perf]Optimize rotary_emb implementation to use Triton operator for improved... · b22980a1
  yexin(叶鑫) authored Apr 25, 2025
```
[Perf]Optimize rotary_emb implementation to use Triton operator for improved inference performance (#16457)
Signed-off-by: cynthieye <yexin93@qq.com>
Co-authored-by: MagnetoWang <magnetowang@outlook.com>
```
  b22980a1
- [Attention] FA3 decode perf improvement - single mma warp group support for head dim 128 (#16864) · 41ca7eb4
  Lucas Wilkinson authored Apr 24, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  41ca7eb4
17 Apr, 2025 1 commit
- [Attention] Update to lastest FA3 code (#13111) · 183dad7a
  Lucas Wilkinson authored Apr 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
```
  183dad7a
05 Apr, 2025 1 commit
- fix: support clang17 for macos and fix the real libomp (#16086) · 6342adc4
  yihong authored Apr 05, 2025
```
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
```
  6342adc4
02 Apr, 2025 1 commit
- [CPU][Bugfix] Using custom allreduce for CPU backend (#15934) · 550b2801
  Li, Jiang authored Apr 02, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  550b2801
25 Mar, 2025 1 commit
- [Kernel][CPU] CPU MLA (#14744) · 4f044b1d
  Thien Tran authored Mar 25, 2025
```
Signed-off-by: Thien Tran <gau.nernst@yahoo.com.sg>
```
  4f044b1d
20 Mar, 2025 1 commit
- [Attention] Flash Attention 3 - fp8 (#14570) · a597a575
  Mickaël Seznec authored Mar 20, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
```
  a597a575
12 Mar, 2025 1 commit

[CPU] Upgrade CPU backend to torch-2.6 (#13381) · ff47aab0

Li, Jiang authored Mar 12, 2025


Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

ff47aab0

06 Mar, 2025 1 commit

Adding cpu inference with VXE ISA for s390x architecture (#12613) · ada19210

Dilip Gowda Bhagavan authored Mar 06, 2025


Signed-off-by: Dilip Gowda Bhagavan <dilip.bhagavan@ibm.com>
Signed-off-by: Rishika Kedia <rishika.kedia@in.ibm.com>
Co-authored-by: Rishika Kedia <rishika.kedia@in.ibm.com>

ada19210