Commits · 580864d81eb03d9fb1383e1782636ff6a9425fa2 · OpenDAS / vllm_cscc

09 Mar, 2026 1 commit

[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA... · 580864d8

Roberto L. Castro authored Mar 09, 2026


[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA query concat - DeepSeek-V3.2 (#34917)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>

580864d8

05 Mar, 2026 1 commit

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

02 Mar, 2026 1 commit

[Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448) · cb21972a

EdalatiAli authored Mar 02, 2026


Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

cb21972a

01 Mar, 2026 1 commit
- [Mamba1] - Kernel Level Chunk Alignment for Prefix Caching (#34798) · bbf81f9a
  Asaf Gardin authored Mar 01, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  bbf81f9a
28 Feb, 2026 1 commit
- [CI/Build] CPU release supports both of AVX2 and AVX512 (#35466) · 90805ff4
  Ma Jian authored Feb 28, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: jiang1.li <jiang1.li@intel.com>
```
  90805ff4
27 Feb, 2026 1 commit
- [Performance] Cublas Bf16 Gate with Fp32 Output (#35121) · 38c498b8
  roikoren755 authored Feb 27, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  38c498b8
26 Feb, 2026 1 commit

[WideEP] Remove pplx all2all backend (#33724) · eb19955c

Tyler Michael Smith authored Feb 26, 2026


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

eb19955c

23 Feb, 2026 1 commit
- [ModelBash][DSV3] Add TRTLLM DSV3 Router GEMM kernel (6% B1 Speedup) (#34302) · 8435b2e0
  Robert Shaw authored Feb 23, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  8435b2e0
18 Feb, 2026 2 commits
- [Model Bash] DeepSeek R1 BF16 Min Latency QKV A GEMM (0.5% E2E Speedup) (#34758) · 6874638b
  Robert Shaw authored Feb 18, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  6874638b
- [Bugfix] Fix quant RMS norm fusion for quantization with TMA-aligned scales (#33255) · a88b3be7
  ElizaWszola authored Feb 18, 2026
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  a88b3be7
11 Feb, 2026 1 commit
- [Bugfix][CPU] Fix llama4 inference on CPU (#34321) · 05339a7b
  Li, Jiang authored Feb 11, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  05339a7b
31 Jan, 2026 1 commit
- [Bugfix][ROCm] Fixing the skinny gemm dispatch logic from #32831 (#33366) · 31aedfe7
  Gregory Shtrasberg authored Jan 30, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  31aedfe7
29 Jan, 2026 1 commit
- [Bugfix] Register fp8 cutlass_group_gemm as supported for only SM90+SM100 (#33285) · 1bd47d6e
  Michael Goin authored Jan 28, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1bd47d6e
28 Jan, 2026 1 commit

[Quantization][Deprecation] Remove Marlin 24 (#32688) · af9b69f9

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

af9b69f9

26 Jan, 2026 1 commit
- [fix] CPUDNNLGEMMHandler pointer baked into inductor artifact (#32913) · 58a05b0c
  dolpm authored Jan 26, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  58a05b0c
25 Jan, 2026 1 commit
- [Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
  Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
  fcb9df99
23 Jan, 2026 2 commits

[Refactor] Rename `gptq_marlin` to `marlin` to match MoE (#32952) · 4561f139
Michael Goin authored Jan 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
4561f139

[CI][AMD][BugFix] Update wvSplitK (and other skinny_gemm wrappers) to ensure... · 6cc6d92b

rasmith authored Jan 23, 2026


[CI][AMD][BugFix] Update wvSplitK (and other skinny_gemm wrappers) to ensure tensors passed will be made contiguous for the kernel (#32831)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

6cc6d92b

22 Jan, 2026 1 commit
- OffloadingConnector: Support kernel_block_size != block_size (#30692) · 421012b6
  Or Ozeri authored Jan 22, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  421012b6
21 Jan, 2026 1 commit
- [Kernel] Add topk_sigmoid kernel (#31246) · 63227acc
  Xin Yang authored Jan 21, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  63227acc
18 Jan, 2026 2 commits
- [Refactor] Remove unused cutlass moe problem size function (#32047) · eebc58df
  Wentao Ye authored Jan 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  eebc58df
- "refactor: refactor_repeated_interfaces" (#32486) · 2f03035a
  tjp_zju authored Jan 18, 2026
```
Signed-off-by: tom-zju <tanjianpingzju1990@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  2f03035a
16 Jan, 2026 1 commit
- Atomics Reduce Counting Optimization for SplitK Skinny GEMMs. (#29843) · 7a103043
  Hashem Hashemi authored Jan 16, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  7a103043
13 Jan, 2026 1 commit

[Kernel][Performance] Enable smaller Scaling Factor tiling for NVFP4 small-batch decoding (#30885) · 8ef50d9a

Roberto L. Castro authored Jan 14, 2026

Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>

8ef50d9a

10 Jan, 2026 1 commit

Fuse RoPE and MLA KV-cache write (#25774) · 80fead8b

PatrykSaffer authored Jan 10, 2026


Signed-off-by: Patryk Saffer <patryk.saffer99@gmail.com>
Signed-off-by: PatrykSaffer <patryk.saffer@mistral.ai>
Co-authored-by: Patryk Saffer <patryk.saffer99@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

80fead8b

09 Jan, 2026 3 commits

[Quant] Make static quant support all group shapes (#30833) · 0a0aa077
Lucas Wilkinson authored Jan 09, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
0a0aa077

[Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput... · 308feab3

Wentao Ye authored Jan 09, 2026


[Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput improvement, 2.2% TTFT improvement (#31830)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

308feab3

[Perf][Kernel] Fused SiLU+Mul+Quant kernel for NVFP4 cutlass_moe (#31832) · 34cd32fe
Michael Goin authored Jan 09, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
34cd32fe

06 Jan, 2026 1 commit
- [Quantization][MoE] remove unused ep logic from moe marlin (#31571) · 2f4bdee6
  Jinzhen Lin authored Jan 07, 2026
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  2f4bdee6
24 Dec, 2025 1 commit
- [Misc] Remove unused custom ops `copy_blocks` and `copy_blocks_mla` (#30967) · 4ed11105
  rongfu.leng authored Dec 24, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  4ed11105
19 Dec, 2025 1 commit
- [MoE Refactor][3/N] Deprecate cutlass block quant fp8 (b200) (#30990) · 83a317f6
  Robert Shaw authored Dec 19, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  83a317f6
18 Dec, 2025 1 commit
- [CPU] Refactor CPU fused MOE (#30531) · e3ab93c8
  Li, Jiang authored Dec 18, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e3ab93c8
14 Dec, 2025 1 commit

[Bugfix] awq_gemm: fix argument order swap (#30364) · e9add129

Matthias Gehre authored Dec 14, 2025


Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

e9add129

12 Dec, 2025 1 commit
- [Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532) · 3e41992f
  Lucas Wilkinson authored Dec 12, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3e41992f
09 Dec, 2025 3 commits
- [bugfix][quantization] Fix fp8 per_tensor scale shape (#30257) · 03416ead
  haoyangli-amd authored Dec 09, 2025
```
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
```
  03416ead
- [Kernel]Support W4A8 Grouped GEMM on Hopper (#29691) · f6227c22
  czhu-cohere authored Dec 08, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  f6227c22
- Lora MoE Align Improvements (#29257) · ea657f20
  gnovack authored Dec 08, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
```
  ea657f20
07 Dec, 2025 2 commits

[Performance] Fused blockwise quant RMS norm (#27883) · af0444bf

ElizaWszola authored Dec 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>

af0444bf

[Kernel][MoE] optimize `moe_align_block_size` (#29642) · 879ddb09

Jinzhen Lin authored Dec 07, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

879ddb09

29 Nov, 2025 1 commit

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37