Commits · 4497431df654e46fb1fb5e64bf8611e762ae5d87 · OpenDAS / vllm_cscc

"vllm/model_executor/models/neuron/mistral.py" did not exist on "3b7178cfa4a317922d4aef9dd3b2647b8d950e7d"

07 Mar, 2026 2 commits
- [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891) · 379689d5
  Wei Zhao authored Mar 07, 2026
  
  379689d5
- mla: don't update kv cache on dummy forwards (#36282) · 24a03915
  Itay Alroy authored Mar 07, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
```
  24a03915
06 Mar, 2026 1 commit

[CustomOp] CustomOp FusedRMSNormGated (#35877) · f3c6c9c9

eellison authored Mar 06, 2026


Signed-off-by: Elias Ellison <elias.ellison@gmail.com>
Signed-off-by: eellison <elias.ellison@gmail.com>

f3c6c9c9

05 Mar, 2026 4 commits
- [Model] Add support for OLMo Hybrid (#32550) · a911f4dd
  Yanhong Li authored Mar 05, 2026
  
  a911f4dd
- [Perf] Optimize FusedMoEModularKernel output tensor using torch.empty (#35794) · f9170209
  Xin Yang authored Mar 05, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  f9170209
- [Bugfix] Disable FlashInfer TRTLLM BF16 path for non-gated MoE (#36146) · 86483ca7
  tomeras91 authored Mar 05, 2026
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  86483ca7
- [Bugfix][CI] fix typos (#34934) · 6a895197
  Jiayi Yan authored Mar 06, 2026
```
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6a895197
04 Mar, 2026 7 commits

[Misc] Support OOT linear method registering (#35981) · 562339ab
Shanshan Shen authored Mar 05, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
562339ab
[Bugfix] Fix passing of activation_type to trtllm fused MoE NVFP4 and FP8 (#36017) · d7adcadb
amitz-nv authored Mar 05, 2026
```
Signed-off-by: amitz-nv <203509407+amitz-nv@users.noreply.github.com>
```
d7adcadb
[Kernel][Mamba] Optimize Mamba2 SSD prefill Triton kernels (#35397) · 7faba503
tomeras91 authored Mar 04, 2026
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
7faba503

[Core] Add All-to-All communication backend for DCP (#34883) · 6cb90109

sungsoo ha authored Mar 04, 2026


Signed-off-by: Sungsoo Ha <sungsooh@nvidia.com>
Signed-off-by: sungsoo ha <hasungsoo@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6cb90109

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

[ROCm][Bugfix] Fall back from CK MXFP4 MoE when GEMM dimensions are unsupported (#35893) · 5dc35387
Chuan (Richard) Li authored Mar 04, 2026
```
Signed-off-by: Li <chuali@amd.com>
```
5dc35387

Enable bnb for multiple indices weight (#35838) · 9a9d4424

xjx authored Mar 04, 2026


Signed-off-by: xjx <493337577@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

9a9d4424

03 Mar, 2026 4 commits

[Bugfix] Fix misnamed parameter in compressed_tensors_moe.py (#35813) · a9b8b13e

bnellnm authored Mar 03, 2026


Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

a9b8b13e

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

[BugFix] Add support for MTP num_speculative_tokens > 1 with sparse MLA (#34552) · 28ef9ba3

Lucas Wilkinson authored Mar 03, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

28ef9ba3

[Misc] Fix typos in comments: explict→explicit, paramaters→parameters (#35648) · 35a6f0bf
lin-shh authored Mar 03, 2026

35a6f0bf

02 Mar, 2026 3 commits

[Core] Move test utility to test file (#35672) · 4034c3d3
Turner Jabbour authored Mar 02, 2026
```
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
```
4034c3d3

[Performance] Extract kv update ops from MLA attention backends (#34627) · d9c77308

ElizaWszola authored Mar 02, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Di Wu <dw2761@nyu.edu>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

d9c77308

[XPU] fix mxfp4 activation type (#35691) · 92f5d0f0
Kunshang Ji authored Mar 02, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
92f5d0f0

01 Mar, 2026 5 commits
- [Attention] FA4 integration (#32974) · 8b5014d3
  Lucas Wilkinson authored Mar 01, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8b5014d3
- [torch.compile] Undo the fast_moe_cold_start hack in torch>=2.11 (#35475) · e82fbeec
  Richard Zou authored Mar 01, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  e82fbeec
- [Bugfix] Fix dtype mismatch in RMSNormGated.forward_native() during torch.compile (#35256) · 62904708
  haosdent authored Mar 02, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  62904708
- fix(mxfp4): return is_monolithic=False when LoRA is enabled for Triton backend (#35382) · 5a435507
  Seungho Yoon authored Mar 01, 2026
```
Signed-off-by: Seungho Yoon <yoonsnowdev@gmail.com>
```
  5a435507
- [Mamba1] - Kernel Level Chunk Alignment for Prefix Caching (#34798) · bbf81f9a
  Asaf Gardin authored Mar 01, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  bbf81f9a
28 Feb, 2026 6 commits

[Chore] Cleanup BNB utilization dead code (#35620) · e94b263b
Isotr0py authored Mar 01, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
e94b263b

[Deprecation] Deprecate code in 0.17 as scheduled (#35441) · e113a301

Wentao Ye authored Feb 28, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

e113a301

[Feat] Add CUDA torch fallbacks for fp8_mqa_logits/fp8_paged_mqa_logits_torch function (#35271) · 7e08c22b
Chauncey authored Feb 28, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
7e08c22b
Add padding support to wvSplitK solution for skinny GEMMs (#33762) · 7600642e
Hashem Hashemi authored Feb 28, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
7600642e

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

[ROCm][Quantization] Add Composable Kernel (CK) backend support for M… (#34301) · d5b6f3ba

Douglas Lehr authored Feb 27, 2026


Signed-off-by: Doug Lehr <douglehr@amd.com>
Signed-off-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Signed-off-by: Douglas Lehr <Doug.Lehr@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>

d5b6f3ba

27 Feb, 2026 6 commits
- [Bugfix][Model] Fix gpt-oss batch invariance (#35404) · 1f3dbd95
  Jakub Zakrzewski authored Feb 27, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
  1f3dbd95
- [Bugfix] Add missing activation attr to RMSNormGated (#35423) · 6467b635
  Tib authored Feb 27, 2026
```
Signed-off-by: tibG <naps@qubes.milou>
Co-authored-by: tibG <naps@qubes.milou>
```
  6467b635
- Flashinfer cuDNN backend for Qwen3 VL ViT attention (#34580) · 9c3fe993
  Max Hu authored Feb 27, 2026
```
Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Shang Wang <shangw@nvidia.com>
```
  9c3fe993
- [Model Performance] Add Qwen3MoE tuned MoE configs for H200 (#35457) · a572baff
  Chengyi Nie authored Feb 26, 2026
```
Signed-off-by: Chengyi Nie <cnie@roblox.com>
Co-authored-by: Chengyi Nie <cnie@roblox.com>
```
  a572baff
- [Bug] correct out dtype of rms_norm_gated native path (#35369) · 516cf266
  zofia authored Feb 27, 2026
```
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  516cf266
- [Performance] Cublas Bf16 Gate with Fp32 Output (#35121) · 38c498b8
  roikoren755 authored Feb 27, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  38c498b8
26 Feb, 2026 2 commits
- [Bugfix] Fix KV Scale loading for MLA Models (#35430) · 62830211
  Pavani Majety authored Feb 26, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  62830211
- [ROCm][Quantization] GPT OSS Upstream MoE wmxfp4_afp8 with static scales (#30357) · 01923eec
  Aleksandr Malyshev authored Feb 26, 2026
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
  01923eec