Commits · d2e2e856ad4daf4b36bb37acaac06f3f61ac84ce · myrfy001 / vllm_dsv4

"...entrypoints/openai/realtime/test_realtime_validation.py" did not exist on "3f7662d6505e441026e668ba78a2207d669f4f32"

21 Apr, 2026 16 commits
- [Frontend] Remove frontend pooling multi task support. (#37861) · d2e2e856
  wang.yuqi authored Apr 21, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
  d2e2e856
- feat(multimodal): support externally processed mm_kwargs with cache injection (#39502) · 766cb65d
  Kris Hung authored Apr 21, 2026
```
Signed-off-by: Krish Hung <krishung5@gmail.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  766cb65d
- fix: clamp NaN/Inf in topk_softmax to prevent duplicate expert IDs (#39391) · 28c22215
  Jhao-Ting Chen authored Apr 21, 2026
```
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
```
  28c22215
- Revert "[Startup] Parallelize torch/transformers import + weight prefetch +... · 3975eb6d
  wang.yuqi authored Apr 21, 2026
```
Revert "[Startup] Parallelize torch/transformers import + weight prefetch + forkserver prewarm" (#40438)
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  3975eb6d
- [Bugfix] Normalize malformed dict prompts that carry token IDs in `prompt` (#40339) · 5a94a198
  Zeyu Zhang authored Apr 21, 2026
```
Signed-off-by: Alchuang22-dev <2584829494@qq.com>
```
  5a94a198
- [Feat] dflash support for ROCm (#39703) · f95c11a8
  hangy-amd authored Apr 21, 2026
```
Signed-off-by: Hang Yang <hangy@amd.com>
```
  f95c11a8
- [MoE] Triton MoE Perf regression - restore low latency path (#39016) · 257015d5
  milesial authored Apr 20, 2026
  
  257015d5
- [MM][Misc] Support image+video mixed inputs (per prompt) for VLM examples (#40335) · b4784001
  Shanshan Shen authored Apr 21, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  b4784001
- [Fix] Add missing space in IP fallback warning (#40359) · 989cc12d
  SeongJun Lee authored Apr 21, 2026
```
Signed-off-by: lesj0610 <lesj0610@gmail.com>
```
  989cc12d
- [Deprecation] Deprecate cprofile and cprofile_context (#39100) · 301024aa
  Wentao Ye authored Apr 20, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  301024aa
- [Startup] Parallelize torch/transformers import + weight prefetch + forkserver prewarm (#40331) · 8256833f
  Simon Mo authored Apr 20, 2026
```
Signed-off-by: simon-mo <simon@inferact.ai>
```
  8256833f
- [Doc] Update ViT CUDA graph doc for mixed (image+video) inputs (#40355) · 80975912
  Shanshan Shen authored Apr 21, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  80975912
- [Bugfix] Gemma4: fix multimodal embedder norm order to match HF reference (#40411) · 20d37434
  Luciano Martins authored Apr 20, 2026
```
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
```
  20d37434
- [Misc] Reduce attention logging levels (#40086) · 18563f20
  Chauncey authored Apr 21, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  18563f20
- [Bugfix] Fix `_CONFIG_REGISTRY` types getting wrong config class when on-disk... · 0e884fe6
  Misa authored Apr 20, 2026
```
[Bugfix] Fix `_CONFIG_REGISTRY` types getting wrong config class when on-disk model_type differs (#39554)
Signed-off-by: Misa <misaAle@users.noreply.github.com>
Signed-off-by: Misael Casarez <misacasa@amazon.com>
Co-authored-by: Misael Casarez <misacasa@amazon.com>
```
  0e884fe6
- [vLLM IR] Add IR op testing and benchmarking infrastructure (#40167) · fe5c115e
  Yanan Cao authored Apr 20, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Theresa Shan <Theresa.Shan@amd.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  fe5c115e
20 Apr, 2026 24 commits
- [Bugfix] Replace code that disabled shared expert overlap (#39222) · 6867bcd0
  bnellnm authored Apr 20, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  6867bcd0
- [Misc][UX] Suppress confusing `num_gpu_blocks` log lines (#40402) · c075702e
  Matthew Bonanni authored Apr 20, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
  c075702e
- [ROCm] Hotfix: guard MLA dual RMS norm fusion against older AITer versions (#40386) · 21b086d0
  Rita Brugarolas authored Apr 20, 2026
```
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
```
  21b086d0
- [EPLB] Consolidate is_unchanged/is_received_locally into TransferMetadata (#37341) · 3173441b
  Sage Moore authored Apr 20, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  3173441b
- [LMCache MP Connector] Add num_lmcache_extra_cached_token in KVTransferParams (#39843) · 8b1f3beb
  Cao Qian authored Apr 20, 2026
```
Signed-off-by: aeon-x <talexcao@gmail.com>
```
  8b1f3beb
- Enable building MoRI with AMD AINIC stack (#38371) · 2390caf1
  Theresa Shan authored Apr 21, 2026
```
Signed-off-by: Theresa Shan <thshan@smci355-ccs-aus-n08-21.prov.aus.ccs.cpe.ice.amd.com>
Signed-off-by: Theresa Shan <theresa.shan@amd.com>
Co-authored-by: Theresa Shan <thshan@smci355-ccs-aus-n08-21.prov.aus.ccs.cpe.ice.amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  2390caf1
- [Core] Cache InductorPass.hash_source with functools.cache (#39328) · 87805fa1
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  87805fa1
- [Bugfix][CI] Fix `tests/distributed/test_torchrun_example_moe.py` (#40349) · 304d5ba1
  Nicolò Lucchesi authored Apr 20, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  304d5ba1
- [WideEP] Remove naive all2all. Use allgather_reducescatter instead (#33728) · 81d954f4
  Tyler Michael Smith authored Apr 20, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  81d954f4
- [Core] Pass donate_graph_module=True to standalone_compile (#39733) · 47fcb8ca
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  47fcb8ca
- Update flashinfer to 0.6.8 (#39959) · 191e3fda
  bai authored Apr 20, 2026
```
Signed-off-by: bai <v@gor.io>
```
  191e3fda
- [Core] Label torch trace logging overhead with dynamo_timed (#39329) · b9cf629b
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  b9cf629b
- [EPLB] Refactor Async EPLB synchronization logic (#37601) · 3461c8b0
  Sage Moore authored Apr 20, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  3461c8b0
- [MoE Refactor] Move the shared/fused expert output sum into MoERunnerBase (#35949) · 726efe17
  bnellnm authored Apr 20, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  726efe17
- [XPU] fix MoE triton backend in online fp8 quantization (#40109) · 59556265
  Yan Ma authored Apr 20, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  59556265
- Properly enable wvSplitK fp8 path for RDNA (#37712) · 3a30eaa1
  Hashem Hashemi authored Apr 20, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  3a30eaa1
- [ROCm] Add MLA dual RMS norm fusion (Q, KV) pass for DeepSeek/Kimi-K2 (#39242) · fb5635d3
  Rita Brugarolas authored Apr 20, 2026
```
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
```
  fb5635d3
- [Bug] Fix dcp error message (#40053) · b42e878e
  Wentao Ye authored Apr 20, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b42e878e
- [ROCm][Feature] Enable AITER MLA attention backend to work with Eagle3... · 7243e02a
  larryli2-amd authored Apr 20, 2026
```
[ROCm][Feature] Enable AITER MLA attention backend to work with Eagle3 speculative decoding on ROCm (#39616)
Signed-off-by: larryli2-amd <larryli2@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  7243e02a
- [CI][EPLB] Add Async EPLB end-to-end integration test to CI (#40168) · def8f522
  Sage Moore authored Apr 20, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  def8f522
- mxfp8 online quant move to new frontend (#40152) · 38fa87ca
  Vasiliy Kuznetsov authored Apr 20, 2026
```
Signed-off-by: Vasiliy Kuznetsov <vasiliy@meta.com>
```
  38fa87ca
- [bugfix] Use only onlines CPUs in lscpu (#40161) · a023edfa
  Galigator authored Apr 20, 2026
```
Signed-off-by: kse <kevin.sejourne@cloud-temple.com>
Co-authored-by: kse <kevin.sejourne@cloud-temple.com>
```
  a023edfa
- [Anthropic][Frontend] Added chat_template_kwargs to /v1/messages (#40125) · b82fc136
  aleksandaryanakiev authored Apr 20, 2026
```
Signed-off-by: Aleksandar Yanakiev <alexander.yanakiev@discretestack.com>
Co-authored-by: Aleksandar Yanakiev <alexander.yanakiev@discretestack.com>
```
  b82fc136
- [XPU] enable triton attention test on XPU by removing cuda device binding (#39627) · e06de7f0
  Yan Ma authored Apr 20, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  e06de7f0