Commits · caad9f1e01ee04e4f5912d0287031ea3a850f6dc · OpenDAS / vllm_cscc

09 Feb, 2026 2 commits
- [Fix] [CPU Backend] : Prepack weights for w8a8 oneDNN matmul (#33901) · caad9f1e
  Nikhil Gupta authored Feb 09, 2026
```
Signed-off-by: nikhil-arm <nikhil.gupta2@arm.com>
```
  caad9f1e
- fix(cpu): fix mla_decode compilation on x86 without AVX512 (#34052) · 5a5c4351
  ihb2032 authored Feb 09, 2026
```
Signed-off-by: ihb2032 <hebome@foxmail.com>
Co-authored-by: root <root@LAPTOP-FKNHV411.localdomain>
```
  5a5c4351
07 Feb, 2026 2 commits
- Perf tuning and expansion of cases covered for wvSplitKrc (#33493) · ed17f54c
  Hashem Hashemi authored Feb 07, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  ed17f54c
- [Kernel] Add enable_sm120_or_later for SM121 (DGX Spark) CUTLASS support (#33517) · bc32444b
  Vel authored Feb 06, 2026
```
Signed-off-by: code4me2 <velvetmoon222999@gmail.com>
```
  bc32444b
06 Feb, 2026 3 commits
- [Refactor] Remove align block size logic in `moe_permute` (#33449) · 77c09e11
  Wentao Ye authored Feb 06, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  77c09e11
- [cpu][performance] CPU Paged Attention NEON BFMMLA BF16 Implementation (#32263) · 1363e3d6
  Gassan Salama authored Feb 06, 2026
```
Signed-off-by: Gassan <gassan.salama@arm.com>
```
  1363e3d6
- [CPU] Add BF16 Kernel type for s390x (#33788) · ac04dd37
  R3hankhan authored Feb 06, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  ac04dd37
05 Feb, 2026 1 commit
- Adds padding and perf improvements to wvSplitK_fp8 (#33527) · d5c48001
  Hashem Hashemi authored Feb 05, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  d5c48001
04 Feb, 2026 1 commit
- [CPU] Split attention dispatch by head_dim alignment (#32161) · 4dffc5e0
  R3hankhan authored Feb 04, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
  4dffc5e0
03 Feb, 2026 1 commit
- [Feature][CPU Backend]: Optimize ARM vectorization backend (#30329) · e69c990c
  Radu Salavat authored Feb 03, 2026
```
Signed-off-by: Radu Salavat <radu.salavat@arm.com>
```
  e69c990c
02 Feb, 2026 2 commits

fix cutlass_3x_gemm_fp8_blockwise on sm103a (#32224) · 089cd4f0

Lain authored Feb 02, 2026


Signed-off-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>

089cd4f0

[Feature][Core] Support Fabric detection to adapt the MNNVL protocol for the GB series (#33540) · 528e9b14

Kebe authored Feb 02, 2026


Signed-off-by: Kebe <mail@kebe7jun.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Thomas Vegas <tvegas@nvidia.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

528e9b14

31 Jan, 2026 1 commit

[Bugfix]: Fix display errors in TORCH_CHECK messages (#32942) · fedf6433

linhaifeng authored Feb 01, 2026


Signed-off-by: linhaifeng <1371675203@qq.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

fedf6433

29 Jan, 2026 2 commits

[Bugfix][CPU] Fix thread num for shared memory communication (#33317) · 8311f083

Li, Jiang authored Jan 29, 2026

Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8311f083

[Doc]: fixing multiple typos in diverse files (#33256) · 31b25f65

Didier Durand authored Jan 29, 2026

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

31b25f65

28 Jan, 2026 3 commits

[Perf] Optimize `moe_permute` for CUTLASS FP8 (#32892) · c4e744db
Wentao Ye authored Jan 28, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
c4e744db

[Quantization][Deprecation] Remove Marlin 24 (#32688) · af9b69f9

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

af9b69f9

Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2eb673a0

27 Jan, 2026 1 commit

[AMD][Kernel][BugFix] Use correct scale in concat_and_cache_ds_mla_kernel when on gfx942 (#32976) · 58996f35

rasmith authored Jan 27, 2026


Signed-off-by: Randall Smith <ransmith@amd.com>
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

58996f35

26 Jan, 2026 1 commit
- [fix] CPUDNNLGEMMHandler pointer baked into inductor artifact (#32913) · 58a05b0c
  dolpm authored Jan 26, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  58a05b0c
25 Jan, 2026 1 commit
- [Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
  Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
  fcb9df99
23 Jan, 2026 3 commits

[Refactor] Rename `gptq_marlin` to `marlin` to match MoE (#32952) · 4561f139
Michael Goin authored Jan 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
4561f139

[CI][AMD][BugFix] Update wvSplitK (and other skinny_gemm wrappers) to ensure... · 6cc6d92b

rasmith authored Jan 23, 2026


[CI][AMD][BugFix] Update wvSplitK (and other skinny_gemm wrappers) to ensure tensors passed will be made contiguous for the kernel (#32831)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

6cc6d92b

[CI/Build][CPU] Fix failed pooling tests and macos smoke test (#32907) · 5da4c7d7

Li, Jiang authored Jan 23, 2026

Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

5da4c7d7

22 Jan, 2026 3 commits
- Add llmcompressor fp8 kv-cache quant (per-tensor and per-attn_head) (#30141) · 44f08af3
  Eldar Kurtić authored Jan 22, 2026
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
Signed-off-by: eldarkurtic <8884008+eldarkurtic@users.noreply.github.com>
```
  44f08af3
- [CPU Backend] [Perf] Accelerate tensor-parallel/data-parallel inference across... · 744ef304
  Fadi Arafeh authored Jan 22, 2026
```
[CPU Backend] [Perf] Accelerate tensor-parallel/data-parallel inference across NUMA domains on Arm (#32792)
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  744ef304
- OffloadingConnector: Support kernel_block_size != block_size (#30692) · 421012b6
  Or Ozeri authored Jan 22, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  421012b6
21 Jan, 2026 2 commits
- [Kernel] Add topk_sigmoid kernel (#31246) · 63227acc
  Xin Yang authored Jan 21, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  63227acc
- [Quantization][Deprecation] Deprecate HQQ (#32681) · 85f55c94
  Robert Shaw authored Jan 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  85f55c94
20 Jan, 2026 1 commit
- [Perf] Only clone when needed for `moe_permute` (#32273) · 6c97b9b9
  Wentao Ye authored Jan 20, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6c97b9b9
18 Jan, 2026 1 commit
- [Refactor] Remove unused cutlass moe problem size function (#32047) · eebc58df
  Wentao Ye authored Jan 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  eebc58df
16 Jan, 2026 2 commits
- Atomics Reduce Counting Optimization for SplitK Skinny GEMMs. (#29843) · 7a103043
  Hashem Hashemi authored Jan 16, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  7a103043
- Add thread_n=64 support to Marlin MoE (#32360) · 83239ff1
  Michael Goin authored Jan 15, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  83239ff1
13 Jan, 2026 1 commit
- [Perf] Optimize grouped topk kernel, 1.2%~2% E2E Throughput improvement (#32058) · f28125d8
  Wentao Ye authored Jan 13, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f28125d8
10 Jan, 2026 2 commits

[Bugfix][Hardware][AMD] Use dynamic WARP_SIZE in sampler vectorized_process (#31295) · c60578de
Kevin McKay authored Jan 09, 2026
```
Signed-off-by: c0de128 <kevin.mckay@outlook.com>
```
c60578de

Fuse RoPE and MLA KV-cache write (#25774) · 80fead8b

PatrykSaffer authored Jan 10, 2026


Signed-off-by: Patryk Saffer <patryk.saffer99@gmail.com>
Signed-off-by: PatrykSaffer <patryk.saffer@mistral.ai>
Co-authored-by: Patryk Saffer <patryk.saffer99@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

80fead8b

09 Jan, 2026 4 commits

[Quant] Make static quant support all group shapes (#30833) · 0a0aa077
Lucas Wilkinson authored Jan 09, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
0a0aa077

[Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput... · 308feab3

Wentao Ye authored Jan 09, 2026


[Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput improvement, 2.2% TTFT improvement (#31830)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

308feab3

[Perf][Kernel] Fused SiLU+Mul+Quant kernel for NVFP4 cutlass_moe (#31832) · 34cd32fe
Michael Goin authored Jan 09, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
34cd32fe
[CPU] Add head sizes 80 and 112 with vec16 fallback (#31968) · 8e27663b
R3hankhan authored Jan 09, 2026
```
Signed-off-by: Rehan Khan <Rehan.Khan7@ibm.com>
```
8e27663b