Commits · 97995f6376fd3dae7a67624055ddf038233e181e · OpenDAS / vllm_cscc

03 Mar, 2026 5 commits
- [MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63
  Robert Shaw authored Mar 03, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>
```
  97995f63
- [BugFix] Add support for MTP num_speculative_tokens > 1 with sparse MLA (#34552) · 28ef9ba3
  Lucas Wilkinson authored Mar 03, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  28ef9ba3
- [Misc] Fix typos in comments: explict→explicit, paramaters→parameters (#35648) · 35a6f0bf
  lin-shh authored Mar 03, 2026
  
  35a6f0bf
- [V0 deprecation] Remove Swin model (#35821) · 8ea8ba27
  Isotr0py authored Mar 03, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  8ea8ba27
- [Model] Add support for nvidia/llama-nemotron-rerank-vl-1b-v2 (#35735) · c8b678e5
  Jakub Zakrzewski authored Mar 03, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
  c8b678e5
02 Mar, 2026 7 commits
- [MoE][Perf] Wrap DSV3 QKVAProj GEMM in custom op for torch.compile (#35751) · 9319044e
  Robert Shaw authored Mar 02, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  9319044e
- [Bugfix] Fix missing sequence_lengths in qwen3_omni_moe_thinker (#35741) · fa6a6be5
  Ye (Charlotte) Qi authored Mar 02, 2026
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  fa6a6be5
- [Spec Decode] Add hidden states extraction system (#33736) · 9433acb8
  Fynn Schmitt-Ulms authored Mar 02, 2026
```
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
```
  9433acb8
- [BugFix][Model]Fix the garbled code in Ernie4.5-VL caused by fast_moe_cold_start (#35587) · 2a9e3347
  CSWYF3634076 authored Mar 03, 2026
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  2a9e3347
- [Core] Move test utility to test file (#35672) · 4034c3d3
  Turner Jabbour authored Mar 02, 2026
```
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
```
  4034c3d3
- [Performance] Extract kv update ops from MLA attention backends (#34627) · d9c77308
  ElizaWszola authored Mar 02, 2026
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Di Wu <dw2761@nyu.edu>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  d9c77308
- [XPU] fix mxfp4 activation type (#35691) · 92f5d0f0
  Kunshang Ji authored Mar 02, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  92f5d0f0
01 Mar, 2026 7 commits
- [Attention] FA4 integration (#32974) · 8b5014d3
  Lucas Wilkinson authored Mar 01, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8b5014d3
- [torch.compile] Undo the fast_moe_cold_start hack in torch>=2.11 (#35475) · e82fbeec
  Richard Zou authored Mar 01, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  e82fbeec
- [Bugfix] Fix dtype mismatch in RMSNormGated.forward_native() during torch.compile (#35256) · 62904708
  haosdent authored Mar 02, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  62904708
- fix(mxfp4): return is_monolithic=False when LoRA is enabled for Triton backend (#35382) · 5a435507
  Seungho Yoon authored Mar 01, 2026
```
Signed-off-by: Seungho Yoon <yoonsnowdev@gmail.com>
```
  5a435507
- [Mamba1] - Kernel Level Chunk Alignment for Prefix Caching (#34798) · bbf81f9a
  Asaf Gardin authored Mar 01, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  bbf81f9a
- Fix typo: implictly -> implicitly in isaac.py docstring (#35646) · a9ec392c
  lin-shh authored Mar 01, 2026
  
  a9ec392c
- [Bugfix][Model] Fix Qwen3.5/Qwen3Next ignoring --dtype flag on older GPUs (#35617) · afd089f2
  lailoo authored Mar 01, 2026
  
  afd089f2
28 Feb, 2026 8 commits

[Chore] Cleanup BNB utilization dead code (#35620) · e94b263b
Isotr0py authored Mar 01, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
e94b263b

[Deprecation] Deprecate code in 0.17 as scheduled (#35441) · e113a301

Wentao Ye authored Feb 28, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

e113a301

Fix Qwen3_5MTP packed_modules_mapping for gate_up_proj (#35581) · 63d7972f
cwazai authored Feb 28, 2026

63d7972f
[Feat] Add CUDA torch fallbacks for fp8_mqa_logits/fp8_paged_mqa_logits_torch function (#35271) · 7e08c22b
Chauncey authored Feb 28, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
7e08c22b
Add padding support to wvSplitK solution for skinny GEMMs (#33762) · 7600642e
Hashem Hashemi authored Feb 28, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
7600642e

[1/N] Elastic EP Milestone 2 (#34861) · dea26833

Itay Alroy authored Feb 28, 2026


Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

dea26833

[MTP] Validate that MTP weights are actually loaded (#35548) · 2562e027
Matthew Bonanni authored Feb 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
2562e027

[ROCm][Quantization] Add Composable Kernel (CK) backend support for M… (#34301) · d5b6f3ba

Douglas Lehr authored Feb 27, 2026


Signed-off-by: Doug Lehr <douglehr@amd.com>
Signed-off-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Signed-off-by: Douglas Lehr <Doug.Lehr@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>

d5b6f3ba

27 Feb, 2026 13 commits

[Bugfix][Model] Fix gpt-oss batch invariance (#35404) · 1f3dbd95
Jakub Zakrzewski authored Feb 27, 2026
```
Signed-off-by: Jakub Zakrzewski <jzakrzewski@nvidia.com>
```
1f3dbd95

[Transformers backend] Ignore MTP weights when num_nextn_predict_layers=0 (#34888) · 2decec98

SteadfastAsArt authored Feb 28, 2026

Signed-off-by: SteadfastAsArt <695488173@qq.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

2decec98

[BugFix] Fix 3D rope in transformers backend (#35097) · fd6de37f

Raushan Turganbay authored Feb 27, 2026


Signed-off-by: raushan <raushan@huggingface.co>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

fd6de37f

Support parakeet as audio encoder for nemotron-nano-vl (#35100) · c8aca0c9

Netanel Haber authored Feb 27, 2026


Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

c8aca0c9

[Model] Add huggingface skt/A.X-K1 model (#32407) · 905d76b5

fort726 authored Feb 28, 2026

Signed-off-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Signed-off-by: fort726 <38447663+fort726@users.noreply.github.com>
Co-authored-by: Sungwan(Alex) Kim <sw0726.kim@sktelecom.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

905d76b5

[Bugfix] Fix check_interleaved_audio_video false positive for batched... · e8249378

Yueqian Lin authored Feb 27, 2026


[Bugfix] Fix check_interleaved_audio_video false positive for batched non-interleaved requests (#35487)
Signed-off-by: linyueqian <linyueqian@outlook.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

e8249378

[Bugfix] Add missing activation attr to RMSNormGated (#35423) · 6467b635
Tib authored Feb 27, 2026
```
Signed-off-by: tibG <naps@qubes.milou>
Co-authored-by: tibG <naps@qubes.milou>
```
6467b635

Flashinfer cuDNN backend for Qwen3 VL ViT attention (#34580) · 9c3fe993

Max Hu authored Feb 27, 2026


Signed-off-by: Max Hu <maxhu@nvidia.com>
Signed-off-by: Max Hu <hyoung2991@gmail.com>
Co-authored-by: Max Hu <maxhu@nvidia.com>
Co-authored-by: Shang Wang <shangw@nvidia.com>

9c3fe993

[Model Performance] Add Qwen3MoE tuned MoE configs for H200 (#35457) · a572baff
Chengyi Nie authored Feb 26, 2026
```
Signed-off-by: Chengyi Nie <cnie@roblox.com>
Co-authored-by: Chengyi Nie <cnie@roblox.com>
```
a572baff

[Bug] correct out dtype of rms_norm_gated native path (#35369) · 516cf266

zofia authored Feb 27, 2026


Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

516cf266

[Bug] Fix outdated links in source code (#35314) · 062b7896
Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
062b7896
[Bugfix] Fix Qwen3NextForCausalLM packed_modules_mapping (#35413) · 1e5ad9b7
Jee Jee Li authored Feb 27, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
1e5ad9b7
[Performance] Cublas Bf16 Gate with Fp32 Output (#35121) · 38c498b8
roikoren755 authored Feb 27, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
38c498b8