Commits · 4a06e1246e30214d644a1732d6853cfe2b935a75 · OpenDAS / vllm_cscc

03 Apr, 2026 2 commits
- [Perf] Batch KV cache swap copies via cuMemcpyBatchAsync (#38460) · 4a06e124
  Itay Etelis authored Apr 03, 2026
```
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  4a06e124
- [Kernel] Fuse FP8 output quantization into merge_attn_states (#36518) · 3bc2734d
  Carl Y authored Apr 02, 2026
```
Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
```
  3bc2734d
02 Apr, 2026 1 commit
- Revert "[Kernel] Add gpt-oss Router GEMM kernel (#37205)" (#38778) · 9bd72311
  Xin Yang authored Apr 01, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  9bd72311
01 Apr, 2026 2 commits
- Feature/silu block quant fusion v1 (#32996) · c09ad767
  Monishver authored Apr 01, 2026
```
Signed-off-by: Monishver Chandrasekaran <monishverchandrasekaran@gmail.com>
```
  c09ad767
- Fix NaN from stale FP4 scale padding in create_fp4_scale_tensor (#38148) · 0fab52f0
  Elvir Crnčević authored Apr 01, 2026
```
Signed-off-by: Elvir Crncevic <elvircrn@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  0fab52f0
31 Mar, 2026 2 commits
- [fix] Remove trtllm ragged mla prefills (#36540) · 598190aa
  Olya Kozlova authored Mar 31, 2026
```
Signed-off-by: Olya Kozlova <okozlova@nvidia.com>
```
  598190aa
- [CPU] Support int8 compute mode in CPU AWQ (#35697) · f09daea2
  Yintong Lu authored Mar 31, 2026
```
Signed-off-by: Yintong Lu <yintong.lu@intel.com>
```
  f09daea2
30 Mar, 2026 1 commit

[Bugfix] Use null block (0) for padded block table entries (#35431) · bcc6f674

SandishKumarHN authored Mar 30, 2026


Signed-off-by: SandishKumarHN <sandish@fb.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

bcc6f674

23 Mar, 2026 1 commit
- [Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799) · 38364a7e
  Kyle Sayers authored Mar 23, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  38364a7e
18 Mar, 2026 1 commit
- [Kernel] Add gpt-oss Router GEMM kernel (#37205) · b1169d7b
  Xin Yang authored Mar 18, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  b1169d7b
17 Mar, 2026 1 commit
- [Kernel] Add non-gated support for NVFP4 CUTLASS MoE (#37320) · 09e4576f
  Michael Goin authored Mar 17, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  09e4576f
16 Mar, 2026 1 commit
- [Custom Ops] Add functional + out variant for scaled_fp4_quant (#34389) · 3e6a1e16
  Terry Gao authored Mar 16, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
```
  3e6a1e16
11 Mar, 2026 1 commit

[torch.compile] Add support for non-contiguous fused RMSNorm + group quant (#36551) · 9556af87

Luka Govedič authored Mar 11, 2026

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>

9556af87

09 Mar, 2026 1 commit

[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA... · 580864d8

Roberto L. Castro authored Mar 09, 2026


[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA query concat - DeepSeek-V3.2 (#34917)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>

580864d8

05 Mar, 2026 1 commit

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

02 Mar, 2026 1 commit

[Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448) · cb21972a

EdalatiAli authored Mar 02, 2026


Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

cb21972a

01 Mar, 2026 1 commit
- [Mamba1] - Kernel Level Chunk Alignment for Prefix Caching (#34798) · bbf81f9a
  Asaf Gardin authored Mar 01, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  bbf81f9a
28 Feb, 2026 1 commit
- [CI/Build] CPU release supports both of AVX2 and AVX512 (#35466) · 90805ff4
  Ma Jian authored Feb 28, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: jiang1.li <jiang1.li@intel.com>
```
  90805ff4
27 Feb, 2026 1 commit
- [Performance] Cublas Bf16 Gate with Fp32 Output (#35121) · 38c498b8
  roikoren755 authored Feb 27, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  38c498b8
26 Feb, 2026 1 commit

[WideEP] Remove pplx all2all backend (#33724) · eb19955c

Tyler Michael Smith authored Feb 26, 2026


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

eb19955c

23 Feb, 2026 1 commit
- [ModelBash][DSV3] Add TRTLLM DSV3 Router GEMM kernel (6% B1 Speedup) (#34302) · 8435b2e0
  Robert Shaw authored Feb 23, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  8435b2e0
18 Feb, 2026 2 commits
- [Model Bash] DeepSeek R1 BF16 Min Latency QKV A GEMM (0.5% E2E Speedup) (#34758) · 6874638b
  Robert Shaw authored Feb 18, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  6874638b
- [Bugfix] Fix quant RMS norm fusion for quantization with TMA-aligned scales (#33255) · a88b3be7
  ElizaWszola authored Feb 18, 2026
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  a88b3be7
11 Feb, 2026 1 commit
- [Bugfix][CPU] Fix llama4 inference on CPU (#34321) · 05339a7b
  Li, Jiang authored Feb 11, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  05339a7b
31 Jan, 2026 1 commit
- [Bugfix][ROCm] Fixing the skinny gemm dispatch logic from #32831 (#33366) · 31aedfe7
  Gregory Shtrasberg authored Jan 30, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  31aedfe7
29 Jan, 2026 1 commit
- [Bugfix] Register fp8 cutlass_group_gemm as supported for only SM90+SM100 (#33285) · 1bd47d6e
  Michael Goin authored Jan 28, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  1bd47d6e
28 Jan, 2026 1 commit

[Quantization][Deprecation] Remove Marlin 24 (#32688) · af9b69f9

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

af9b69f9

26 Jan, 2026 1 commit
- [fix] CPUDNNLGEMMHandler pointer baked into inductor artifact (#32913) · 58a05b0c
  dolpm authored Jan 26, 2026
```
Signed-off-by: dolpm <34420038+dolpm@users.noreply.github.com>
```
  58a05b0c
25 Jan, 2026 1 commit
- [Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
  Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
  fcb9df99
23 Jan, 2026 2 commits

[Refactor] Rename `gptq_marlin` to `marlin` to match MoE (#32952) · 4561f139
Michael Goin authored Jan 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
4561f139

[CI][AMD][BugFix] Update wvSplitK (and other skinny_gemm wrappers) to ensure... · 6cc6d92b

rasmith authored Jan 23, 2026


[CI][AMD][BugFix] Update wvSplitK (and other skinny_gemm wrappers) to ensure tensors passed will be made contiguous for the kernel (#32831)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

6cc6d92b

22 Jan, 2026 1 commit
- OffloadingConnector: Support kernel_block_size != block_size (#30692) · 421012b6
  Or Ozeri authored Jan 22, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  421012b6
21 Jan, 2026 1 commit
- [Kernel] Add topk_sigmoid kernel (#31246) · 63227acc
  Xin Yang authored Jan 21, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  63227acc
18 Jan, 2026 2 commits
- [Refactor] Remove unused cutlass moe problem size function (#32047) · eebc58df
  Wentao Ye authored Jan 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  eebc58df
- "refactor: refactor_repeated_interfaces" (#32486) · 2f03035a
  tjp_zju authored Jan 18, 2026
```
Signed-off-by: tom-zju <tanjianpingzju1990@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  2f03035a
16 Jan, 2026 1 commit
- Atomics Reduce Counting Optimization for SplitK Skinny GEMMs. (#29843) · 7a103043
  Hashem Hashemi authored Jan 16, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  7a103043
13 Jan, 2026 1 commit

[Kernel][Performance] Enable smaller Scaling Factor tiling for NVFP4 small-batch decoding (#30885) · 8ef50d9a

Roberto L. Castro authored Jan 14, 2026

Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>

8ef50d9a

10 Jan, 2026 1 commit

Fuse RoPE and MLA KV-cache write (#25774) · 80fead8b

PatrykSaffer authored Jan 10, 2026


Signed-off-by: Patryk Saffer <patryk.saffer99@gmail.com>
Signed-off-by: PatrykSaffer <patryk.saffer@mistral.ai>
Co-authored-by: Patryk Saffer <patryk.saffer99@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

80fead8b

09 Jan, 2026 2 commits

[Quant] Make static quant support all group shapes (#30833) · 0a0aa077
Lucas Wilkinson authored Jan 09, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
0a0aa077

[Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput... · 308feab3

Wentao Ye authored Jan 09, 2026


[Perf] Optimize cutlass moe problem size calculation, 5.3% E2E Throughput improvement, 2.2% TTFT improvement (#31830)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

308feab3