Commits · 82155c76762b3281a46e0fce60c6202c564afea3 · OpenDAS / vllm_cscc

24 Mar, 2026 1 commit
- skip cp_gather_and_upconvert_fp8_kv_cache · 82155c76
  zhuwenwen authored Mar 24, 2026
  
  82155c76
18 Mar, 2026 1 commit
- [Custom Ops] Add functional + out variant for scaled_fp4_quant (#34389) · eeabf740
  Terry Gao authored Mar 16, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
(cherry picked from commit 3e6a1e16)
```
  eeabf740
11 Mar, 2026 1 commit

[torch.compile] Add support for non-contiguous fused RMSNorm + group quant (#36551) · 9556af87

Luka Govedič authored Mar 11, 2026

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>

9556af87

09 Mar, 2026 1 commit

[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA... · 580864d8

Roberto L. Castro authored Mar 09, 2026


[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA query concat - DeepSeek-V3.2 (#34917)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>

580864d8

05 Mar, 2026 1 commit

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

02 Mar, 2026 1 commit

[Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448) · cb21972a

EdalatiAli authored Mar 02, 2026


Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

cb21972a

01 Mar, 2026 1 commit
- [Mamba1] - Kernel Level Chunk Alignment for Prefix Caching (#34798) · bbf81f9a
  Asaf Gardin authored Mar 01, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  bbf81f9a
28 Feb, 2026 1 commit
- [CI/Build] CPU release supports both of AVX2 and AVX512 (#35466) · 90805ff4
  Ma Jian authored Feb 28, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: jiang1.li <jiang1.li@intel.com>
```
  90805ff4
27 Feb, 2026 1 commit
- [Performance] Cublas Bf16 Gate with Fp32 Output (#35121) · 38c498b8
  roikoren755 authored Feb 27, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  38c498b8
26 Feb, 2026 1 commit

[WideEP] Remove pplx all2all backend (#33724) · eb19955c

Tyler Michael Smith authored Feb 26, 2026


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

eb19955c

23 Feb, 2026 1 commit
- [ModelBash][DSV3] Add TRTLLM DSV3 Router GEMM kernel (6% B1 Speedup) (#34302) · 8435b2e0
  Robert Shaw authored Feb 23, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  8435b2e0
18 Feb, 2026 2 commits
- [Model Bash] DeepSeek R1 BF16 Min Latency QKV A GEMM (0.5% E2E Speedup) (#34758) · 6874638b
  Robert Shaw authored Feb 18, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  6874638b
- [Bugfix] Fix quant RMS norm fusion for quantization with TMA-aligned scales (#33255) · a88b3be7
  ElizaWszola authored Feb 18, 2026
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  a88b3be7
11 Feb, 2026 1 commit
- [Bugfix][CPU] Fix llama4 inference on CPU (#34321) · 05339a7b
  Li, Jiang authored Feb 11, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  05339a7b
05 Feb, 2026 2 commits
- sync v0.15.1 · de889cb6
  zhuwenwen authored Feb 05, 2026
  
  de889cb6
- sync v0.15.1 · c721b814
  zhuwenwen authored Feb 05, 2026
  
  c721b814
02 Feb, 2026 2 commits
- [Bugfix][ROCm] Fixing the skinny gemm dispatch logic from #32831 (#33366) · 5f45b0b7
  Gregory Shtrasberg authored Jan 30, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
(cherry picked from commit 31aedfe7)
```
  5f45b0b7
- [Bugfix] Register fp8 cutlass_group_gemm as supported for only SM90+SM100 (#33285) · 39e8b493
  Michael Goin authored Jan 28, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
(cherry picked from commit 1bd47d6e)
```
  39e8b493
31 Jan, 2026 1 commit
- [Bugfix][ROCm] Fixing the skinny gemm dispatch logic from #32831 (#33366) · 31aedfe7
  Gregory Shtrasberg authored Jan 30, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  31aedfe7
29 Jan, 2026 1 commit
- [Bugfix] Register fp8 cutlass_group_gemm as supported for only SM90+SM100 (#33285) · 1bd47d6e
  Michael Goin authored Jan 28, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1bd47d6e
28 Jan, 2026 1 commit

[Quantization][Deprecation] Remove Marlin 24 (#32688) · af9b69f9

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

af9b69f9

26 Jan, 2026 1 commit
- [fix] CPUDNNLGEMMHandler pointer baked into inductor artifact (#32913) · 58a05b0c
  dolpm authored Jan 26, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  58a05b0c
25 Jan, 2026 1 commit
- [Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
  Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
  fcb9df99
23 Jan, 2026 4 commits
- [Refactor] Rename `gptq_marlin` to `marlin` to match MoE (#32952) · 4561f139
  Michael Goin authored Jan 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4561f139
- [CI][AMD][BugFix] Update wvSplitK (and other skinny_gemm wrappers) to ensure... · 6cc6d92b
  rasmith authored Jan 23, 2026
```
[CI][AMD][BugFix] Update wvSplitK (and other skinny_gemm wrappers) to ensure tensors passed will be made contiguous for the kernel (#32831)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  6cc6d92b
- remove unused code · b8025f24
  zhuwenwen authored Jan 23, 2026
  
  b8025f24
- remove gemm and moe nn layout · 3b2aefb1
  zhuwenwen authored Jan 23, 2026
  
  3b2aefb1
22 Jan, 2026 1 commit
- OffloadingConnector: Support kernel_block_size != block_size (#30692) · 421012b6
  Or Ozeri authored Jan 22, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  421012b6
21 Jan, 2026 2 commits
- [Kernel] Add topk_sigmoid kernel (#31246) · 63227acc
  Xin Yang authored Jan 21, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  63227acc
- skip concat_and_cache_mla_rope_fused · b09a0d7b
  zhuwenwen authored Jan 21, 2026
  
  b09a0d7b
18 Jan, 2026 2 commits
- [Refactor] Remove unused cutlass moe problem size function (#32047) · eebc58df
  Wentao Ye authored Jan 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  eebc58df
- "refactor: refactor_repeated_interfaces" (#32486) · 2f03035a
  tjp_zju authored Jan 18, 2026
```
Signed-off-by: tom-zju <tanjianpingzju1990@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  2f03035a
16 Jan, 2026 1 commit
- Atomics Reduce Counting Optimization for SplitK Skinny GEMMs. (#29843) · 7a103043
  Hashem Hashemi authored Jan 16, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  7a103043
13 Jan, 2026 1 commit

[Kernel][Performance] Enable smaller Scaling Factor tiling for NVFP4 small-batch decoding (#30885) · 8ef50d9a

Roberto L. Castro authored Jan 14, 2026

Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>

8ef50d9a

10 Jan, 2026 1 commit

Fuse RoPE and MLA KV-cache write (#25774) · 80fead8b

PatrykSaffer authored Jan 10, 2026


Signed-off-by: Patryk Saffer <patryk.saffer99@gmail.com>
Signed-off-by: PatrykSaffer <patryk.saffer@mistral.ai>
Co-authored-by: Patryk Saffer <patryk.saffer99@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

80fead8b

09 Jan, 2026 3 commits

[Quant] Make static quant support all group shapes (#30833) · 0a0aa077
Lucas Wilkinson authored Jan 09, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
0a0aa077

[Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput... · 308feab3

Wentao Ye authored Jan 09, 2026


[Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput improvement, 2.2% TTFT improvement (#31830)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

308feab3

[Perf][Kernel] Fused SiLU+Mul+Quant kernel for NVFP4 cutlass_moe (#31832) · 34cd32fe
Michael Goin authored Jan 09, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
34cd32fe

06 Jan, 2026 1 commit
- [Quantization][MoE] remove unused ep logic from moe marlin (#31571) · 2f4bdee6
  Jinzhen Lin authored Jan 07, 2026
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  2f4bdee6
24 Dec, 2025 1 commit
- [Misc] Remove unused custom ops `copy_blocks` and `copy_blocks_mla` (#30967) · 4ed11105
  rongfu.leng authored Dec 24, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  4ed11105