Commits · b47840019e61a3983c8144066a99c843d177947d · OpenDAS / vllm_cscc · GitLab

21 Apr, 2026 9 commits
- [MM][Misc] Support image+video mixed inputs (per prompt) for VLM examples (#40335) · b4784001
  Shanshan Shen authored Apr 21, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  b4784001
- [Fix] Add missing space in IP fallback warning (#40359) · 989cc12d
  SeongJun Lee authored Apr 21, 2026
```
Signed-off-by: lesj0610 <lesj0610@gmail.com>
```
  989cc12d
- [Deprecation] Deprecate cprofile and cprofile_context (#39100) · 301024aa
  Wentao Ye authored Apr 20, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  301024aa
- [Startup] Parallelize torch/transformers import + weight prefetch + forkserver prewarm (#40331) · 8256833f
  Simon Mo authored Apr 20, 2026
```
Signed-off-by: simon-mo <simon@inferact.ai>
```
  8256833f
- [Doc] Update ViT CUDA graph doc for mixed (image+video) inputs (#40355) · 80975912
  Shanshan Shen authored Apr 21, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  80975912
- [Bugfix] Gemma4: fix multimodal embedder norm order to match HF reference (#40411) · 20d37434
  Luciano Martins authored Apr 20, 2026
```
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
```
  20d37434
- [Misc] Reduce attention logging levels (#40086) · 18563f20
  Chauncey authored Apr 21, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  18563f20
- [Bugfix] Fix `_CONFIG_REGISTRY` types getting wrong config class when on-disk... · 0e884fe6
  Misa authored Apr 20, 2026
```
[Bugfix] Fix `_CONFIG_REGISTRY` types getting wrong config class when on-disk model_type differs (#39554)
Signed-off-by: Misa <misaAle@users.noreply.github.com>
Signed-off-by: Misael Casarez <misacasa@amazon.com>
Co-authored-by: Misael Casarez <misacasa@amazon.com>
```
  0e884fe6
- [vLLM IR] Add IR op testing and benchmarking infrastructure (#40167) · fe5c115e
  Yanan Cao authored Apr 20, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Theresa Shan <Theresa.Shan@amd.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  fe5c115e
20 Apr, 2026 31 commits
- [Bugfix] Replace code that disabled shared expert overlap (#39222) · 6867bcd0
  bnellnm authored Apr 20, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  6867bcd0
- [Misc][UX] Suppress confusing `num_gpu_blocks` log lines (#40402) · c075702e
  Matthew Bonanni authored Apr 20, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
  c075702e
- [ROCm] Hotfix: guard MLA dual RMS norm fusion against older AITer versions (#40386) · 21b086d0
  Rita Brugarolas authored Apr 20, 2026
```
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
```
  21b086d0
- [EPLB] Consolidate is_unchanged/is_received_locally into TransferMetadata (#37341) · 3173441b
  Sage Moore authored Apr 20, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  3173441b
- [LMCache MP Connector] Add num_lmcache_extra_cached_token in KVTransferParams (#39843) · 8b1f3beb
  Cao Qian authored Apr 20, 2026
```
Signed-off-by: aeon-x <talexcao@gmail.com>
```
  8b1f3beb
- Enable building MoRI with AMD AINIC stack (#38371) · 2390caf1
  Theresa Shan authored Apr 21, 2026
```
Signed-off-by: Theresa Shan <thshan@smci355-ccs-aus-n08-21.prov.aus.ccs.cpe.ice.amd.com>
Signed-off-by: Theresa Shan <theresa.shan@amd.com>
Co-authored-by: Theresa Shan <thshan@smci355-ccs-aus-n08-21.prov.aus.ccs.cpe.ice.amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  2390caf1
- [Core] Cache InductorPass.hash_source with functools.cache (#39328) · 87805fa1
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  87805fa1
- [Bugfix][CI] Fix `tests/distributed/test_torchrun_example_moe.py` (#40349) · 304d5ba1
  Nicolò Lucchesi authored Apr 20, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  304d5ba1
- [WideEP] Remove naive all2all. Use allgather_reducescatter instead (#33728) · 81d954f4
  Tyler Michael Smith authored Apr 20, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  81d954f4
- [Core] Pass donate_graph_module=True to standalone_compile (#39733) · 47fcb8ca
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  47fcb8ca
- Update flashinfer to 0.6.8 (#39959) · 191e3fda
  bai authored Apr 20, 2026
```
Signed-off-by: bai <v@gor.io>
```
  191e3fda
- [Core] Label torch trace logging overhead with dynamo_timed (#39329) · b9cf629b
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  b9cf629b
- [EPLB] Refactor Async EPLB synchronization logic (#37601) · 3461c8b0
  Sage Moore authored Apr 20, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  3461c8b0
- [MoE Refactor] Move the shared/fused expert output sum into MoERunnerBase (#35949) · 726efe17
  bnellnm authored Apr 20, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  726efe17
- [XPU] fix MoE triton backend in online fp8 quantization (#40109) · 59556265
  Yan Ma authored Apr 20, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  59556265
- Properly enable wvSplitK fp8 path for RDNA (#37712) · 3a30eaa1
  Hashem Hashemi authored Apr 20, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  3a30eaa1
- [ROCm] Add MLA dual RMS norm fusion (Q, KV) pass for DeepSeek/Kimi-K2 (#39242) · fb5635d3
  Rita Brugarolas authored Apr 20, 2026
```
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
```
  fb5635d3
- [Bug] Fix dcp error message (#40053) · b42e878e
  Wentao Ye authored Apr 20, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b42e878e
- [ROCm][Feature] Enable AITER MLA attention backend to work with Eagle3... · 7243e02a
  larryli2-amd authored Apr 20, 2026
```
[ROCm][Feature] Enable AITER MLA attention backend to work with Eagle3 speculative decoding on ROCm (#39616)
Signed-off-by: larryli2-amd <larryli2@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  7243e02a
- [CI][EPLB] Add Async EPLB end-to-end integration test to CI (#40168) · def8f522
  Sage Moore authored Apr 20, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  def8f522
- mxfp8 online quant move to new frontend (#40152) · 38fa87ca
  Vasiliy Kuznetsov authored Apr 20, 2026
```
Signed-off-by: Vasiliy Kuznetsov <vasiliy@meta.com>
```
  38fa87ca
- [bugfix] Use only onlines CPUs in lscpu (#40161) · a023edfa
  Galigator authored Apr 20, 2026
```
Signed-off-by: kse <kevin.sejourne@cloud-temple.com>
Co-authored-by: kse <kevin.sejourne@cloud-temple.com>
```
  a023edfa
- [Anthropic][Frontend] Added chat_template_kwargs to /v1/messages (#40125) · b82fc136
  aleksandaryanakiev authored Apr 20, 2026
```
Signed-off-by: Aleksandar Yanakiev <alexander.yanakiev@discretestack.com>
Co-authored-by: Aleksandar Yanakiev <alexander.yanakiev@discretestack.com>
```
  b82fc136
- [XPU] enable triton attention test on XPU by removing cuda device binding (#39627) · e06de7f0
  Yan Ma authored Apr 20, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  e06de7f0
- nixl refactor [2/N]: unify TpKVTopology + HeteroTPTransferConfig into TransferTopology (#39529) · cc3993b0
  zhanqiuhu authored Apr 20, 2026
```
Signed-off-by: Zhanqiu Hu <zhu@redhat.com>
```
  cc3993b0
- [EPLB] Add nixl-based eplb communicator (#36276) · 50dd4cb4
  Ilya Markov authored Apr 20, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Markov Ilya <markovilya19@gmail.com>
```
  50dd4cb4
- [kv_offload+HMA][4/N]: Support sliding window lookup (#36645) · f774ba02
  Or Ozeri authored Apr 20, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  f774ba02
- [CPU][BugFix] Fix inter-node pipeline parallel (#40150) · 2aab9acf
  Fadi Arafeh authored Apr 20, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  2aab9acf
- [Bugfix] Fix scaled_mm output narrowing for 3D input tensors (#38093) · 58631d7c
  nemanjaudovic authored Apr 20, 2026
```
Signed-off-by: nemanjaudovic <nudovic@amd.com>
```
  58631d7c
- [ROCm][CI] Introducing new MI300 nodes (#39531) · a943839e
  Andreas Karatzas authored Apr 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  a943839e
- [Docs] Fix thinking_token_budget docs (#40316) · 6d8b8080
  milesial authored Apr 20, 2026
```
Signed-off-by: milesial <milesial@users.noreply.github.com>
```
  6d8b8080