Commits · 2463f00fb690a7b182050285c0179da03aad66fe · OpenDAS / vllm_cscc

"tests/evals/gsm8k/__init__.py" did not exist on "02f0c7b220422792f5e53de2a7d51d2d3ff2df28"

22 Apr, 2026 4 commits

[Bugfix] Fix W4A8_FP8 MoE tp>1 correctness and view() TypeError (#40310) · f946659f

EdalatiAli authored Apr 21, 2026

Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

f946659f

[NIXL][XPU]Fix nixl import on XPU (#40430) · f90aa446
Soila Kavulya authored Apr 21, 2026
```
Signed-off-by: Soila Kavulya <soila.p.kavulya.intel.com>
```
f90aa446

[ROCm][P/D][MORI][BugFix] Ensure correct api is used when making requests to... · cefa5281

rasmith authored Apr 21, 2026


[ROCm][P/D][MORI][BugFix] Ensure correct api is used when making requests to prefill / decode nodes (#39835)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>

cefa5281

[Bugfix] avoid warmup if text only expectation in multi_modal run (#40409) · 6ff8dea0
Khushali Desai authored Apr 21, 2026
```
Signed-off-by: khushali9 <khushali.desai9@gmail.com>
```
6ff8dea0

21 Apr, 2026 30 commits

[Startup][UX] Enable CUDAGraph memory profiling by default (#38284) · 96a85c57
Matthew Bonanni authored Apr 21, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
96a85c57

[MoE Refactor] Add more MoE layer tests (#39349) · 9db4650e

bnellnm authored Apr 21, 2026

Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

9db4650e

[MoE Refactor] Remove SharedFusedMoE class (#35782) · 5e584ce9
bnellnm authored Apr 21, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
5e584ce9
[Refactor] Remove unused param (#39750) · 1842447c
Wentao Ye authored Apr 21, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1842447c
[Perf] Optimize batch invariant with fused rms norm, 2.1% E2E latency improvement (#40413) · 16688b26
Wentao Ye authored Apr 21, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
16688b26

[Performance] Add is_reasoning_end_streaming() override to GptOssReasoningParser (#35745) · 5544f8c1

Fergus authored Apr 21, 2026


Signed-off-by: Fergus <fergus.barratt00@gmail.com>
Signed-off-by: fergus barratt <fergus.barratt00@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

5544f8c1

[Bugfix] Fix spec decode test failures on Blackwell (SM100+) (#39546) · 9f39b380

Rishi Puri authored Apr 21, 2026


Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Signed-off-by: Rishi Puri <puririshi98@berkeley.edu>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>

9f39b380

[MRv2]fix: model accuracy regression caused by reusing the stale... · 9a6a66f3

Zijing Liu authored Apr 21, 2026


[MRv2]fix: model accuracy regression caused by reusing the stale last_sampled_tokens and draft_tokens (#39833)
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>

9a6a66f3

Add new tp plan styles to the Transformers modelling backend (#40467) · 6ee081d1
Harry Mellor authored Apr 21, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
6ee081d1

[Model Runner V2] Multiple prompt logprobs support (#39937) · 66cc3fa5

Wentao Ye authored Apr 21, 2026


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

66cc3fa5

Revert #38730 and #38791 (#40032) · 6d85b36a

Vadim Gimpelson authored Apr 21, 2026


Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>

6d85b36a

[UX] Bump version in CG memory profiling log message (#40465) · ab5666eb
Matthew Bonanni authored Apr 21, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
ab5666eb

Default to 'align' mamba cache mode for Mamba-based models when speculative... · f819265a

roikoren755 authored Apr 21, 2026


Default to 'align' mamba cache mode for Mamba-based models when speculative decoding is enabled (#40454)
Signed-off-by: Roi Koren <roik@nvidia.com>

f819265a

[MM][CG] Optimize default `max_frames_per_batch` auto-infer for ViT CUDA graph... · 936e0b79

Shanshan Shen authored Apr 21, 2026


[MM][CG] Optimize default `max_frames_per_batch` auto-infer for ViT CUDA graph video inference (#40445)
Signed-off-by: shen-shanshan <467638484@qq.com>

936e0b79

[Bugfix] LoRA: extend expert base_layer loading to Qwen3.5 and Step3.x (#37114) · 908a7134
ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Apr 21, 2026
```
Signed-off-by: Hollow Man <hollowman@opensuse.org>
```
908a7134

[Bugfix] Fix dataset name and path argument validation bug in vllm bench serve (#40288) · 7b1e0b07

Talor Abramovich authored Apr 21, 2026

Signed-off-by: talora <talora@nvidia.com>
Signed-off-by: Talor Abramovich <talor19@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

7b1e0b07

Add Granite 4.1 Vision as built-in multimodal model (#40282) · d249a9e9

artem-spector authored Apr 21, 2026


Signed-off-by: Artem Spector <artems@il.ibm.com>
Signed-off-by: artemspector <artems@il.ibm.com>
Co-authored-by: artemspector <artems@il.ibm.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

d249a9e9

[Frontend] Remove frontend pooling multi task support. (#37861) · d2e2e856

wang.yuqi authored Apr 21, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

d2e2e856

feat(multimodal): support externally processed mm_kwargs with cache injection (#39502) · 766cb65d

Kris Hung authored Apr 21, 2026


Signed-off-by: Krish Hung <krishung5@gmail.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

766cb65d

Revert "[Startup] Parallelize torch/transformers import + weight prefetch +... · 3975eb6d

wang.yuqi authored Apr 21, 2026


Revert "[Startup] Parallelize torch/transformers import + weight prefetch + forkserver prewarm" (#40438)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>

3975eb6d

[Bugfix] Normalize malformed dict prompts that carry token IDs in `prompt` (#40339) · 5a94a198
Zeyu Zhang authored Apr 21, 2026
```
Signed-off-by: Alchuang22-dev <2584829494@qq.com>
```
5a94a198
[Feat] dflash support for ROCm (#39703) · f95c11a8
hangy-amd authored Apr 21, 2026
```
Signed-off-by: Hang Yang <hangy@amd.com>
```
f95c11a8
[MoE] Triton MoE Perf regression - restore low latency path (#39016) · 257015d5
milesial authored Apr 20, 2026

257015d5
[Fix] Add missing space in IP fallback warning (#40359) · 989cc12d
SeongJun Lee authored Apr 21, 2026
```
Signed-off-by: lesj0610 <lesj0610@gmail.com>
```
989cc12d
[Deprecation] Deprecate cprofile and cprofile_context (#39100) · 301024aa
Wentao Ye authored Apr 20, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
301024aa
[Startup] Parallelize torch/transformers import + weight prefetch + forkserver prewarm (#40331) · 8256833f
Simon Mo authored Apr 20, 2026
```
Signed-off-by: simon-mo <simon@inferact.ai>
```
8256833f

[Bugfix] Gemma4: fix multimodal embedder norm order to match HF reference (#40411) · 20d37434

Luciano Martins authored Apr 20, 2026


Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>

20d37434

[Misc] Reduce attention logging levels (#40086) · 18563f20
Chauncey authored Apr 21, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
18563f20

[Bugfix] Fix `_CONFIG_REGISTRY` types getting wrong config class when on-disk... · 0e884fe6

Misa authored Apr 20, 2026


[Bugfix] Fix `_CONFIG_REGISTRY` types getting wrong config class when on-disk model_type differs (#39554)
Signed-off-by: Misa <misaAle@users.noreply.github.com>
Signed-off-by: Misael Casarez <misacasa@amazon.com>
Co-authored-by: Misael Casarez <misacasa@amazon.com>

0e884fe6

[vLLM IR] Add IR op testing and benchmarking infrastructure (#40167) · fe5c115e

Yanan Cao authored Apr 20, 2026


Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Theresa Shan <Theresa.Shan@amd.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

fe5c115e

20 Apr, 2026 6 commits
- [Bugfix] Replace code that disabled shared expert overlap (#39222) · 6867bcd0
  bnellnm authored Apr 20, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  6867bcd0
- [Misc][UX] Suppress confusing `num_gpu_blocks` log lines (#40402) · c075702e
  Matthew Bonanni authored Apr 20, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
  c075702e
- [ROCm] Hotfix: guard MLA dual RMS norm fusion against older AITer versions (#40386) · 21b086d0
  Rita Brugarolas authored Apr 20, 2026
```
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
```
  21b086d0
- [EPLB] Consolidate is_unchanged/is_received_locally into TransferMetadata (#37341) · 3173441b
  Sage Moore authored Apr 20, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  3173441b
- [LMCache MP Connector] Add num_lmcache_extra_cached_token in KVTransferParams (#39843) · 8b1f3beb
  Cao Qian authored Apr 20, 2026
```
Signed-off-by: aeon-x <talexcao@gmail.com>
```
  8b1f3beb
- [Core] Cache InductorPass.hash_source with functools.cache (#39328) · 87805fa1
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  87805fa1