Commits · 32e45636e3d7e02615facc8c63645ce4ac1d7e11 · OpenDAS / vllm_cscc

26 Apr, 2026 1 commit
- [LoRA] MoE LoRA Refactor (#40338) · 8cd174fa
  Jee Jee Li authored Apr 26, 2026
  
  8cd174fa
25 Apr, 2026 2 commits
- [Bugfix][MoE] Only unpad routed output before shared expert add or routed output transform (#40865) · 12a3f645
  Netanel Haber authored Apr 25, 2026
```
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  12a3f645
- [Opt] Optimize deepstack buffer handling for multimodal Qwen3 models (#40145) · 6646c0c7
  labAxiaoming authored Apr 25, 2026
```
Signed-off-by: xiaoming <1259730330@qq.com>
```
  6646c0c7
24 Apr, 2026 13 commits
- [Refactor] Remove unused dead code (#40640) · a474da28
  Wentao Ye authored Apr 24, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a474da28
- [EPLB] Fix replica selection bias in fused_moe router (#40810) · 333529de
  Artem Perevedentsev authored Apr 25, 2026
```
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
```
  333529de
- [Quantization] add humming quantization kernel (#34556) · 9f771b3a
  Jinzhen Lin authored Apr 24, 2026
  
  9f771b3a
- fused_moe: treat NIXL EP as batched experts (#40412) · c9d3c6e6
  Itay Alroy authored Apr 24, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
```
  c9d3c6e6
- [Bugfix][MoE] Unpad routed output before shared expert add [Fixes #35949] (#40794) · e8eb0490
  Netanel Haber authored Apr 24, 2026
```
Signed-off-by: Netanel Haber <nhaber@nvidia.com>
```
  e8eb0490
- [Attention] use diff kv backend for mimo v2 flash (#40045) · e8ee2a78
  Jiangyun Zhu authored Apr 24, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  e8ee2a78
- Fix Nano Nemotron VL static image inputs (#40724) · 9ad5abe7
  milesial authored Apr 24, 2026
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  9ad5abe7
- [Model] Gemma4: add bidirectional vision attention for sliding layers with window guard (#40534) · 512f5221
  Luciano Martins authored Apr 24, 2026
```
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Luciano Martins <lucianomartins@google.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  512f5221
- [XPU] Enable torch.compile for XPU GDN attention (#39466) · 4c34b2f6
  Yuwen Zhou authored Apr 24, 2026
```
Signed-off-by: yuwenzho <yuwen.zhou@intel.com>
Signed-off-by: Yuwen Zhou <yuwen.zhou@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  4c34b2f6
- [MoE] Move cutlass moe to fused_moe/experts/ (#40574) · 079a4cf3
  Jackmin801 authored Apr 23, 2026
```
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  079a4cf3
- [Core] Avoid seq_lens_cpu GPU->CPU sync (#40654) · fe85a92e
  Nick Hill authored Apr 23, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  fe85a92e
- [ROCm] Cast score correction bias tensor during model construction for DeepSeek/Kimi-K2 (#39999) · fa4b7055
  Hemanth Acharya authored Apr 24, 2026
```
Signed-off-by: Hemanth Acharya <heachary@amd.com>
```
  fa4b7055
- [MoE] Move remaining PrepareAndFinalize to prepare finalize folder (#39009) · 447c372a
  Jackmin801 authored Apr 23, 2026
```
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>
```
  447c372a
23 Apr, 2026 8 commits

[Bugfix] Fix DeepSeek V2-Lite Accuracy drop (#40673) · 4a6dd1c3
bnellnm authored Apr 23, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
4a6dd1c3

[MoE] Move xpu moe to fused_moe/experts/ (#40568) · 1b1c01de

Jackmin801 authored Apr 23, 2026


Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

1b1c01de

[MoE Refactor] Rename FusedMoE.make_expert_params_mapping to... · 1c2c1eb8

bnellnm authored Apr 23, 2026


[MoE Refactor] Rename FusedMoE.make_expert_params_mapping to fused_moe_make_expert_params_mapping (#40671)
Signed-off-by: Bill Nell <bnell@redhat.com>

1c2c1eb8

[Bugfix] Make Attention Backend Auto-Selection Batch-Invariance-Aware (#40193) · b7a26050

Srreyansh Sethi authored Apr 23, 2026


Signed-off-by: Srreyansh Sethi <srreyansh.sethi@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

b7a26050

[Model] Support Hy3 preview (#40681) · d0009ddb

stevenkuang authored Apr 23, 2026


Signed-off-by: stevenkuang <stevenkuang@tencent.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

d0009ddb

[MM][CG] Support `--enable-vit-cuda-graph` option for VLM examples (#40580) · fe57be78
Shanshan Shen authored Apr 23, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
fe57be78

[MoE refactor] refactor GPTQMarlinMoEMethod with MK (#37990) · e4ee48da

Kunshang Ji authored Apr 23, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>

e4ee48da

[BugFix]fix Qwen3 MoE call gate twice (#40664) · 342c58bc
Kunshang Ji authored Apr 23, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
342c58bc

22 Apr, 2026 14 commits

[Bugfix][Torch 2.12] Fix batch_invariant test with allow_override for torch 2.12 upgrade (#40562) · 22fa63cf
Lucas Kabela authored Apr 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
22fa63cf

[Refactor] Clean up log once `scope="local"` (#40540) · 8f87eb46

Wentao Ye authored Apr 22, 2026

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8f87eb46

[NVFP4] NVFP4 MOE emulation fallback for H100/MI300/MI350, standardize... · d622e27d

fxmarty-amd authored Apr 22, 2026


[NVFP4] NVFP4 MOE emulation fallback for H100/MI300/MI350, standardize `TritonExperts` usage for OCP MX emulation (#35737)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>

d622e27d

[MoE] Convert CT W8A8 To Oracle Structure (#39187) · 5f76b3fb

Robert Shaw authored Apr 22, 2026


Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>

5f76b3fb

[MoE Refactor] Combine MoERunnerBase + DefaultMoERunner (#40560) · 809d83c2
bnellnm authored Apr 22, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
809d83c2
[xpu][rocm] Update `current_platform.supports_fp8()` for TritonExperts (#40132) · a4905133
Hank_ authored Apr 22, 2026
```
Signed-off-by: Hank <hcc.mayday@gmail.com>
```
a4905133

[Bugfix] LoRA for DeepSeek V3.2 (#35077) · a250f1bd

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Apr 22, 2026


Signed-off-by: Hollow Man <hollowman@opensuse.org>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a250f1bd

support hotwords for FunASR model (#39674) · 9047288b

AllenDou authored Apr 22, 2026


Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>

9047288b

[Model] Add block-local attention and YaRN for local layers to Gemma3 (#39823) · 12367487
philip-essential authored Apr 21, 2026
```
Signed-off-by: Philip Monk <169196560+philip-essential@users.noreply.github.com>
```
12367487

[Audio] Bundle `get_generation_prompt()` params into `SpeechToTextParams` (#36268) · 4eafc729

Ekagra Ranjan authored Apr 22, 2026

Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4eafc729

[compile] mla + group fp8 fusion (#38877) · 4506319a

Carl Y authored Apr 21, 2026


Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

4506319a

[Bugfix] Fix quantized model initialization failure with prefetch offloading (#40432) · 9b60e2ff

Rishapveer Singh authored Apr 22, 2026


Signed-off-by: Rishapveer Singh <singhrishapveer@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

9b60e2ff

[MyPy] Enable mypy for `vllm/model_executor/layers/` (#40159) · 3951d3ea
Martin Hickey authored Apr 22, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
3951d3ea

[Bugfix] Fix W4A8_FP8 MoE tp>1 correctness and view() TypeError (#40310) · f946659f

EdalatiAli authored Apr 21, 2026

Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

f946659f

21 Apr, 2026 2 commits

[MoE Refactor] Add more MoE layer tests (#39349) · 9db4650e

bnellnm authored Apr 21, 2026

Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

9db4650e

[MoE Refactor] Remove SharedFusedMoE class (#35782) · 5e584ce9
bnellnm authored Apr 21, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
5e584ce9