Commits · a4905133f375ec721be441e7ec4a3f923daa28f3 · OpenDAS / vllm_cscc

"tests/vscode:/vscode.git/clone" did not exist on "9a5664d4a4d212a6ebad79b15b11eb8d3ab2a0b2"

22 Apr, 2026 18 commits

[xpu][rocm] Update `current_platform.supports_fp8()` for TritonExperts (#40132) · a4905133
Hank_ authored Apr 22, 2026
```
Signed-off-by: Hank <hcc.mayday@gmail.com>
```
a4905133

[Bugfix] LoRA for DeepSeek V3.2 (#35077) · a250f1bd

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Apr 22, 2026


Signed-off-by: Hollow Man <hollowman@opensuse.org>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a250f1bd

support hotwords for FunASR model (#39674) · 9047288b

AllenDou authored Apr 22, 2026


Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>

9047288b

[Multimodal] Support custom video metadata for pre-extracted frame sequences (#40133) · 6aa057c9

storyicon authored Apr 22, 2026


Signed-off-by: storyicon <storyicon@foxmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

6aa057c9

[Bugfix] [Reasoning] Add reasoning_start_str/reasoning_end_str properties to... · a2bd09c9

Chauncey authored Apr 22, 2026


[Bugfix] [Reasoning] Add reasoning_start_str/reasoning_end_str properties to reasoning parsers (#40566)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

a2bd09c9

[Model] Add block-local attention and YaRN for local layers to Gemma3 (#39823) · 12367487
philip-essential authored Apr 21, 2026
```
Signed-off-by: Philip Monk <169196560+philip-essential@users.noreply.github.com>
```
12367487

[kv_offload+HMA][8/N]: Support multi-group worker transfer (#38453) · aad88f84

Or Ozeri authored Apr 22, 2026


Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

aad88f84

[Bugfix] Pass effective chat template kwargs to reasoning parsers (#40460) · 0210024a
Bugen Zhao authored Apr 22, 2026
```
Signed-off-by: Bugen Zhao <i@bugenzhao.com>
```
0210024a

[Audio] Bundle `get_generation_prompt()` params into `SpeechToTextParams` (#36268) · 4eafc729

Ekagra Ranjan authored Apr 22, 2026

Signed-off-by: Ekagra Ranjan <3116519+ekagra-ranjan@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4eafc729

[ROCm] Support non-causal attention in ROCM_ATTN (#40176) · 6d097697
Micah Williamson authored Apr 21, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
6d097697

[compile] mla + group fp8 fusion (#38877) · 4506319a

Carl Y authored Apr 21, 2026


Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

4506319a

[Bugfix] Fix quantized model initialization failure with prefetch offloading (#40432) · 9b60e2ff

Rishapveer Singh authored Apr 22, 2026


Signed-off-by: Rishapveer Singh <singhrishapveer@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

9b60e2ff

[MyPy] Enable mypy for `vllm/model_executor/layers/` (#40159) · 3951d3ea
Martin Hickey authored Apr 22, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
3951d3ea

[Multimodal] Add PyAV video backend for concurrent video decoding (#39986) · 6f2c71be

Jaseel Muhammad authored Apr 22, 2026


Signed-off-by: Jaseel Muhammad <jaseel.muhammad@mbzuai.ac.ae>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

6f2c71be

[Bugfix] Fix W4A8_FP8 MoE tp>1 correctness and view() TypeError (#40310) · f946659f

EdalatiAli authored Apr 21, 2026

Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

f946659f

[NIXL][XPU]Fix nixl import on XPU (#40430) · f90aa446
Soila Kavulya authored Apr 21, 2026
```
Signed-off-by: Soila Kavulya <soila.p.kavulya.intel.com>
```
f90aa446

[ROCm][P/D][MORI][BugFix] Ensure correct api is used when making requests to... · cefa5281

rasmith authored Apr 21, 2026


[ROCm][P/D][MORI][BugFix] Ensure correct api is used when making requests to prefill / decode nodes (#39835)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

cefa5281

[Bugfix] avoid warmup if text only expectation in multi_modal run (#40409) · 6ff8dea0
Khushali Desai authored Apr 21, 2026
```
Signed-off-by: khushali9 <khushali.desai9@gmail.com>
```
6ff8dea0

21 Apr, 2026 22 commits

[Startup][UX] Enable CUDAGraph memory profiling by default (#38284) · 96a85c57
Matthew Bonanni authored Apr 21, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
96a85c57

[MoE Refactor] Add more MoE layer tests (#39349) · 9db4650e

bnellnm authored Apr 21, 2026

Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

9db4650e

[MoE Refactor] Remove SharedFusedMoE class (#35782) · 5e584ce9
bnellnm authored Apr 21, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
5e584ce9
[Refactor] Remove unused param (#39750) · 1842447c
Wentao Ye authored Apr 21, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1842447c
[Perf] Optimize batch invariant with fused rms norm, 2.1% E2E latency improvement (#40413) · 16688b26
Wentao Ye authored Apr 21, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
16688b26

[Performance] Add is_reasoning_end_streaming() override to GptOssReasoningParser (#35745) · 5544f8c1

Fergus authored Apr 21, 2026


Signed-off-by: Fergus <fergus.barratt00@gmail.com>
Signed-off-by: fergus barratt <fergus.barratt00@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

5544f8c1

[Bugfix] Fix spec decode test failures on Blackwell (SM100+) (#39546) · 9f39b380

Rishi Puri authored Apr 21, 2026


Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Signed-off-by: Rishi Puri <puririshi98@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>

9f39b380

[MRv2]fix: model accuracy regression caused by reusing the stale... · 9a6a66f3

Zijing Liu authored Apr 21, 2026


[MRv2]fix: model accuracy regression caused by reusing the stale last_sampled_tokens and draft_tokens (#39833)
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>

9a6a66f3

Add new tp plan styles to the Transformers modelling backend (#40467) · 6ee081d1
Harry Mellor authored Apr 21, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
6ee081d1

[Model Runner V2] Multiple prompt logprobs support (#39937) · 66cc3fa5

Wentao Ye authored Apr 21, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

66cc3fa5

Revert #38730 and #38791 (#40032) · 6d85b36a

Vadim Gimpelson authored Apr 21, 2026


Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>

6d85b36a

[UX] Bump version in CG memory profiling log message (#40465) · ab5666eb
Matthew Bonanni authored Apr 21, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
ab5666eb

Default to 'align' mamba cache mode for Mamba-based models when speculative... · f819265a

roikoren755 authored Apr 21, 2026


Default to 'align' mamba cache mode for Mamba-based models when speculative decoding is enabled (#40454)
Signed-off-by: Roi Koren <roik@nvidia.com>

f819265a

[MM][CG] Optimize default `max_frames_per_batch` auto-infer for ViT CUDA graph... · 936e0b79

Shanshan Shen authored Apr 21, 2026


[MM][CG] Optimize default `max_frames_per_batch` auto-infer for ViT CUDA graph video inference (#40445)
Signed-off-by: shen-shanshan <467638484@qq.com>

936e0b79

[Bugfix] LoRA: extend expert base_layer loading to Qwen3.5 and Step3.x (#37114) · 908a7134
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Apr 21, 2026
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
```
908a7134

[Bugfix] Fix dataset name and path argument validation bug in vllm bench serve (#40288) · 7b1e0b07

Talor Abramovich authored Apr 21, 2026

Signed-off-by: talora <talora@nvidia.com>
Signed-off-by: Talor Abramovich <talor19@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

7b1e0b07

Add Granite 4.1 Vision as built-in multimodal model (#40282) · d249a9e9

artem-spector authored Apr 21, 2026


Signed-off-by: Artem Spector <artems@il.ibm.com>
Signed-off-by: artemspector <artems@il.ibm.com>
Co-authored-by: artemspector <artems@il.ibm.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

d249a9e9

[Frontend] Remove frontend pooling multi task support. (#37861) · d2e2e856

wang.yuqi authored Apr 21, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

d2e2e856

feat(multimodal): support externally processed mm_kwargs with cache injection (#39502) · 766cb65d

Kris Hung authored Apr 21, 2026


Signed-off-by: Krish Hung <krishung5@gmail.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

766cb65d

Revert "[Startup] Parallelize torch/transformers import + weight prefetch +... · 3975eb6d

wang.yuqi authored Apr 21, 2026


Revert "[Startup] Parallelize torch/transformers import + weight prefetch + forkserver prewarm" (#40438)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>

3975eb6d

[Bugfix] Normalize malformed dict prompts that carry token IDs in `prompt` (#40339) · 5a94a198
Zeyu Zhang authored Apr 21, 2026
```
Signed-off-by: Alchuang22-dev <2584829494@qq.com>
```
5a94a198
[Feat] dflash support for ROCm (#39703) · f95c11a8
hangy-amd authored Apr 21, 2026
```
Signed-off-by: Hang Yang <hangy@amd.com>
```
f95c11a8