Commits · 98a242ff61f7264f6bb7e2d8dd6f78c8496fb39e · OpenDAS / vllm_cscc

23 Apr, 2026 6 commits

[compile] Skip FX graph deserialiaztion on loading, further reducing warm compile time. (#40151) · 98a242ff
Zhengxu Chen authored Apr 23, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
98a242ff

[MoE refactor] refactor GPTQMarlinMoEMethod with MK (#37990) · e4ee48da

Kunshang Ji authored Apr 23, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>

e4ee48da

[BugFix]fix Qwen3 MoE call gate twice (#40664) · 342c58bc
Kunshang Ji authored Apr 23, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
342c58bc

[TurboQuant] enable FA3/FA4 for prefill paths (#40092) · fe9c3d6c

Julian Huang authored Apr 23, 2026


Signed-off-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Codex <codex@openai.com>

fe9c3d6c

[XPU] disable fusion pattern support on XPU platform (#39789) · ccaf5ffa

Chaojun Zhang authored Apr 23, 2026


Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

ccaf5ffa

[BE] Fix compile time message to be consistent (use monitoring) (#40641) · 0283f303
Lucas Kabela authored Apr 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
0283f303

22 Apr, 2026 34 commits

[Fix][MoRI] Align MoRI-IO message format with P2pNcclConnector and vllm-router (#39565) · ac58e2a1
Simon Danielsson authored Apr 23, 2026
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Matvei Pashkovskii <mpashkov@amd.com>
```
ac58e2a1
[Bugfix] Fix RMS norm + quant fusion on DeepGEMM UE8M0 path for B200 (#40552) · b8401a9b
Lucas Kabela authored Apr 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
b8401a9b
[gRPC] Add standard gRPC health checking (grpc.health.v1) for Kubernetes native probes (#38016) · 9c271f94
Honglin Cao authored Apr 22, 2026
```
Signed-off-by: Honglin Cao <Caohonglin317@hotmail.com>
```
9c271f94
[Bugfix][Torch 2.12] Fix batch_invariant test with allow_override for torch 2.12 upgrade (#40562) · 22fa63cf
Lucas Kabela authored Apr 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
22fa63cf

[Refactor] Clean up log once `scope="local"` (#40540) · 8f87eb46

Wentao Ye authored Apr 22, 2026

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8f87eb46

[Bugfix][Parser] Fix Mistral pre-v11 tool parser failing on trailing model output (#40531) · cfa49213

Doug Smith authored Apr 22, 2026


Signed-off-by: dougbtv <dosmith@redhat.com>
Signed-off-by: Doug Smith <dougbtv@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>

cfa49213

FlexAttention non-causal support (#40394) · 29f64c5f

Fynn Schmitt-Ulms authored Apr 22, 2026


Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

29f64c5f

Fix test_startup.py for torch 2.12 (#40636) · eb6661d5
Angela Yi authored Apr 22, 2026
```
Signed-off-by: Angela Yi <yiangela7@gmail.com>
```
eb6661d5

[NVFP4] NVFP4 MOE emulation fallback for H100/MI300/MI350, standardize... · d622e27d

fxmarty-amd authored Apr 22, 2026


[NVFP4] NVFP4 MOE emulation fallback for H100/MI300/MI350, standardize `TritonExperts` usage for OCP MX emulation (#35737)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>

d622e27d

[MoE] Convert CT W8A8 To Oracle Structure (#39187) · 5f76b3fb

Robert Shaw authored Apr 22, 2026


Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>

5f76b3fb

[MoE Refactor] Combine MoERunnerBase + DefaultMoERunner (#40560) · 809d83c2
bnellnm authored Apr 22, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
809d83c2

[Bugfix][CI] Fix... · 33ef1941

Nicolò Lucchesi authored Apr 22, 2026


[Bugfix][CI] Fix `v1/kv_connector/unit/test_nixl_connector_hma.py::test_fewer_blocks_with_hma` (#40597)
Signed-off-by: NickLucche <nlucches@redhat.com>

33ef1941

[xpu][rocm] Update `current_platform.supports_fp8()` for TritonExperts (#40132) · a4905133
Hank_ authored Apr 22, 2026
```
Signed-off-by: Hank <hcc.mayday@gmail.com>
```
a4905133

[Doc] Clarify supported keys for --speculative-config (#40455) · ecbe42e9

xiao authored Apr 22, 2026


Signed-off-by: Wangxiaoxiaoa <Wangxiaoxiaoa@users.noreply.github.com>
Co-authored-by: Wangxiaoxiaoa <Wangxiaoxiaoa@users.noreply.github.com>

ecbe42e9

[Bugfix] LoRA for DeepSeek V3.2 (#35077) · a250f1bd

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Apr 22, 2026


Signed-off-by: Hollow Man <hollowman@opensuse.org>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a250f1bd

[Bugfix][CPU][RISC-V] Clamp exp() input to prevent NaN (#40428) · 04eac6ba
lyd1992 authored Apr 22, 2026
```
Signed-off-by: liuyudong <liuyudong@iscas.ac.cn>
```
04eac6ba

support hotwords for FunASR model (#39674) · 9047288b

AllenDou authored Apr 22, 2026


Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>

9047288b

upgrade tpu-inference to v0.18.0 (#40395) · ed6d3037
Johnny Yang authored Apr 22, 2026

ed6d3037

[Multimodal] Support custom video metadata for pre-extracted frame sequences (#40133) · 6aa057c9

storyicon authored Apr 22, 2026


Signed-off-by: storyicon <storyicon@foxmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

6aa057c9

[Bugfix] [Reasoning] Add reasoning_start_str/reasoning_end_str properties to... · a2bd09c9

Chauncey authored Apr 22, 2026


[Bugfix] [Reasoning] Add reasoning_start_str/reasoning_end_str properties to reasoning parsers (#40566)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

a2bd09c9

[Model] Add block-local attention and YaRN for local layers to Gemma3 (#39823) · 12367487
philip-essential authored Apr 21, 2026
```
Signed-off-by: Philip Monk <169196560+philip-essential@users.noreply.github.com>
```
12367487
[fix] flaky test_mla_attn_quant_fusion.py (#40530) · 4254aeb5
Carl Y authored Apr 21, 2026
```
Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
```
4254aeb5

[kv_offload+HMA][8/N]: Support multi-group worker transfer (#38453) · aad88f84

Or Ozeri authored Apr 22, 2026


Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

aad88f84

[Bugfix] Pass effective chat template kwargs to reasoning parsers (#40460) · 0210024a
Bugen Zhao authored Apr 22, 2026
```
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
```
0210024a

[Audio] Bundle `get_generation_prompt()` params into `SpeechToTextParams` (#36268) · 4eafc729

Ekagra Ranjan authored Apr 22, 2026

Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4eafc729

[ROCm] Support non-causal attention in ROCM_ATTN (#40176) · 6d097697
Micah Williamson authored Apr 21, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
6d097697

[compile] mla + group fp8 fusion (#38877) · 4506319a

Carl Y authored Apr 21, 2026


Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

4506319a

[Bugfix] Fix quantized model initialization failure with prefetch offloading (#40432) · 9b60e2ff

Rishapveer Singh authored Apr 22, 2026


Signed-off-by: Rishapveer Singh <singhrishapveer@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

9b60e2ff

[MyPy] Enable mypy for `vllm/model_executor/layers/` (#40159) · 3951d3ea
Martin Hickey authored Apr 22, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
3951d3ea

[Multimodal] Add PyAV video backend for concurrent video decoding (#39986) · 6f2c71be

Jaseel Muhammad authored Apr 22, 2026


Signed-off-by: Jaseel Muhammad <jaseel.muhammad@mbzuai.ac.ae>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

6f2c71be

[AMD][CI][BugFix] Override normalize_e4m3fn_to_e4m3fnuz for fnuz machines in... · 2463f00f

rasmith authored Apr 21, 2026


[AMD][CI][BugFix] Override normalize_e4m3fn_to_e4m3fnuz for fnuz machines in test_moe_layer_no_parallel (#40550)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

2463f00f

[Bugfix] Fix W4A8_FP8 MoE tp>1 correctness and view() TypeError (#40310) · f946659f

EdalatiAli authored Apr 21, 2026

Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

f946659f

[NIXL][XPU]Fix nixl import on XPU (#40430) · f90aa446
Soila Kavulya authored Apr 21, 2026
```
Signed-off-by: Soila Kavulya <soila.p.kavulya.intel.com>
```
f90aa446

[ROCm][P/D][MORI][BugFix] Ensure correct api is used when making requests to... · cefa5281

rasmith authored Apr 21, 2026


[ROCm][P/D][MORI][BugFix] Ensure correct api is used when making requests to prefill / decode nodes (#39835)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

cefa5281