Commits · 729eb59f60866d3f7c94b0f6fed05b73eef9f7bb · OpenDAS / vllm_cscc

"docs/router/kv_cache_routing.md" did not exist on "9e8f67ed0fd975bf8d9bb39fdc5e60946df34b84"

07 Apr, 2026 6 commits
- [Bug] Fix Trtllm Fp8 MoE Weight Shuffle Memory Fragamentation (#39054) · 0be9516e
  Wei Zhao authored Apr 07, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  0be9516e
- [vLLM IR] rework gemma_rms_norm (#39014) · 8060bb03
  Jiangyun Zhu authored Apr 07, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
Signed-off-by: Jiangyun Zhu <riverclouds.zhu@qq.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  8060bb03
- [Model] Use AutoWeightsLoader for FalconH1 (#39092) · da4c0e4d
  Rishapveer Singh authored Apr 07, 2026
```
Signed-off-by: Rishapveer Singh <215205492+rishaps@users.noreply.github.com>
```
  da4c0e4d
- nano-nemotron-vl: get_mm_max_tokens_per_item for audio, video, image == seq_len (#38727) · a9a0e055
  Netanel Haber authored Apr 07, 2026
```
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
```
  a9a0e055
- [Kernels][MoE] Fix legacy_routing to use bitmatrix-based routing path (#38504) · 2df2c85b
  Andreas Karatzas authored Apr 06, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  2df2c85b
- [MoE Refactor] Split up compressed_tensors_moe.py (#38960) · b2b2c523
  bnellnm authored Apr 06, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  b2b2c523
06 Apr, 2026 11 commits

[NVFP4] Support NVFP4 dense models from `modelopt` and `compressed-tensors` on... · 00d7b497

fxmarty-amd authored Apr 07, 2026


[NVFP4] Support NVFP4 dense models from `modelopt` and `compressed-tensors` on AMD Instinct MI300, MI355X and Hopper through emulation (#35733)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>

00d7b497

NemotronH default mamba_ssm_cache_dtype=float32; enable auto-hook for... · dfa5062a

Netanel Haber authored Apr 06, 2026


NemotronH default mamba_ssm_cache_dtype=float32; enable auto-hook for NemotronHNanoVLV2Config (#39032)
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>

dfa5062a

[Quantization] Add FlashInfer CuteDSL batched experts backend for NVFP4 MoE (#38251) · e8ebbdde

Yongye Zhu authored Apr 06, 2026


Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

e8ebbdde

[EASY] Drop duplicate KV-cache initialization (#38799) · 94fbb098
namgyu-youn authored Apr 07, 2026
```
Signed-off-by: namgyu-youn <namgyu.dev@gmail.com>
```
94fbb098

[MoE Refactor][Test] FusedMoE layer test (#24675) · f0148240

bnellnm authored Apr 06, 2026


Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

f0148240

[MoE Refactor] Split of DefaultMoERunner class (#35326) · 93bada49

bnellnm authored Apr 06, 2026


Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

93bada49

[Refactor] Remove unused dead code (#38842) · 4ae218c1
Wentao Ye authored Apr 06, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
4ae218c1
[Gemma4] Enable Fast Prefill Optimization (#38879) · 47e60509
Lucas Wilkinson authored Apr 06, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
47e60509

[Model] Add support for BharatGen's Param2MoE model (#38000) · c5e3454e

bhargav-patel-29 authored Apr 06, 2026


Signed-off-by: bhargav-patel-29 <bhargav.patel@tihiitb.org>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c5e3454e

MiniMax-M2: add Eagle3 speculative decoding support (#37512) · f6983f01

liuchenbing2026 authored Apr 06, 2026


Signed-off-by: liuchenbing <chenliumail@163.com>
Signed-off-by: liucb <liuchengbao_work@163.com>
Co-authored-by: liuchenbing <chenliumail@163.com>

f6983f01

[ROCm][Quantization] Add asymmetric INT8 quantization support to... · 780ba374

Andreas Karatzas authored Apr 05, 2026


[ROCm][Quantization] Add asymmetric INT8 quantization support to TritonInt8ScaledMMLinearKernel (#38501)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>

780ba374

05 Apr, 2026 5 commits

nano_nemotron_vl: fix tensor device mismatch exception when video profiling (#39029) · d56e9522
Netanel Haber authored Apr 06, 2026
```
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
```
d56e9522

[Bug] Fix Import paths for `encoder_cudagraph` modules (#38997) · 4dd49b06

Greg Pereira authored Apr 05, 2026

Signed-off-by: greg pereira <grpereir@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

4dd49b06

[Perf] Change Trtllm fp8 MoE to use Shuffled Weights and BlockMajorK Layout (#38993) · 1af6f78a

Wei Zhao authored Apr 05, 2026


Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

1af6f78a

[Bugfix][MoE] Fix 6-8% decode regression: prefer multi-stream shared expert overlap (#38990) · 228023b3

Martin Vit authored Apr 05, 2026


Signed-off-by: Martin Vit <martin@voipmonitor.org>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

228023b3

[Quantization][Deprecation] Remove Petit NVFP4 (#32694) · 968ed02a
Robert Shaw authored Apr 04, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
968ed02a

04 Apr, 2026 6 commits

Revert "[vLLM IR] gemma_rms_norm" (#38998) · 7d266abb
Robert Shaw authored Apr 04, 2026

7d266abb
[vLLM IR] gemma_rms_norm (#38780) · 156405d2
Xiaoshuang Wang authored Apr 05, 2026
```
Signed-off-by: Icey <1790571317@qq.com>
```
156405d2

[Perf][GDN] Align TMA usage with upstream FLA (#38981) · 99e5539a

Artem Perevedentsev authored Apr 04, 2026


Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

99e5539a

[IR][RmsNorm] pass None if not has_weight (#38961) · a88ce94b

Linkun authored Apr 04, 2026

Signed-off-by: Linkun Chen <github@lkchen.net>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

a88ce94b

Refactor Arctic loading to use AutoWeightsLoader (#38955) · 93726b2a

lalit10 authored Apr 03, 2026


Signed-off-by: Lalit Laxminarayan Bangad <lalitbangad@gmail.com>
Co-authored-by: Lalit Laxminarayan Bangad <lalitbangad@meta.com>

93726b2a

[Bugfix] Fix DSV32 weight loading (#38870) · 8617f867
Yongye Zhu authored Apr 03, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
8617f867

03 Apr, 2026 12 commits

[Bugfix][LoRA] Fix missing in_proj_z in Qwen3_5ForConditionalGenerati… (#38927) · 81994e1d
elenalil-aws authored Apr 03, 2026
```
Signed-off-by: elenalil-aws <elenalil@amazon.com>
```
81994e1d
[Bugfix] Re-enable Renormalize routing for TRT-LLM MoE experts (#38859) · a5a623d9
yzong-rh authored Apr 03, 2026
```
Signed-off-by: Yifan Zong <yzong@redhat.com>
```
a5a623d9
[Frontend] new online quantization frontend (#38138) · 7b1a7423
Vasiliy Kuznetsov authored Apr 03, 2026
```
Signed-off-by: Vasiliy Kuznetsov <vasiliy@meta.com>
```
7b1a7423

[Bugfix] Fix AWQ models batch invariance issues (#38670) · 46f02e00

Yusuf Mohammad authored Apr 03, 2026


Signed-off-by: yusuf <yusuf@deeplearningmachine.mynet>
Signed-off-by: <>
Co-authored-by: yusuf <yusuf@deeplearningmachine.mynet>

46f02e00

[XPU] bump up xpu-kernel v0.1.5, transpose moe weights (#38342) · 6b487224

Qiming Zhang authored Apr 03, 2026


Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
Signed-off-by: Qiming Zhang <qiming1.zhang@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

6b487224

[GDN] Eliminate GPU->CPU sync in prepare_chunk_indices during prefill (#38361) · cb10b7e8

Artem Perevedentsev authored Apr 03, 2026


Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>

cb10b7e8

[Intel][Triton] Support `round_int8` for Intel backend (#38825) · bf8b022e

Mieszko Dziadowiec authored Apr 03, 2026


Signed-off-by: Mieszko Dziadowiec <mdziadowiec@habana.ai>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

bf8b022e

Fix Nano Nemotron VL regressions (#38655) · fa9e6802
Netanel Haber authored Apr 03, 2026
```
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
```
fa9e6802
[Misc] Clean up Gemma4 implementation (#38872) · 55064354
Isotr0py authored Apr 03, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
55064354
[Bug] Add e_score_correction_bias to SKIP_TENSORS (#38746) · 4729b908
Aaron Hao authored Apr 02, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
4729b908
[Model] Add Phi4ForCausalLMV for microsoft/Phi-4-reasoning-vision-15B (#38306) · 2ad7c033
Varun Sundar Rabindranath authored Apr 03, 2026
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
2ad7c033

[ROCm][Quantization][1/N] Refactor quark_moe w_mxfp4 w/ oracle (#38774) · 103f0de5

Bowen Bao authored Apr 02, 2026


Signed-off-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

103f0de5