Commits · 8b1f3bebcab8f501e13183f84b20635cf336ccc1 · OpenDAS / vllm_cscc · GitLab

20 Apr, 2026 38 commits
- [LMCache MP Connector] Add num_lmcache_extra_cached_token in KVTransferParams (#39843) · 8b1f3beb
  Cao Qian authored Apr 20, 2026
```
Signed-off-by: aeon-x <talexcao@gmail.com>
```
  8b1f3beb
- Enable building MoRI with AMD AINIC stack (#38371) · 2390caf1
  Theresa Shan authored Apr 21, 2026
```
Signed-off-by: Theresa Shan <thshan@smci355-ccs-aus-n08-21.prov.aus.ccs.cpe.ice.amd.com>
Signed-off-by: Theresa Shan <theresa.shan@amd.com>
Co-authored-by: Theresa Shan <thshan@smci355-ccs-aus-n08-21.prov.aus.ccs.cpe.ice.amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  2390caf1
- [Core] Cache InductorPass.hash_source with functools.cache (#39328) · 87805fa1
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  87805fa1
- [Bugfix][CI] Fix `tests/distributed/test_torchrun_example_moe.py` (#40349) · 304d5ba1
  Nicolò Lucchesi authored Apr 20, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  304d5ba1
- [WideEP] Remove naive all2all. Use allgather_reducescatter instead (#33728) · 81d954f4
  Tyler Michael Smith authored Apr 20, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  81d954f4
- [Core] Pass donate_graph_module=True to standalone_compile (#39733) · 47fcb8ca
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  47fcb8ca
- Update flashinfer to 0.6.8 (#39959) · 191e3fda
  bai authored Apr 20, 2026
```
Signed-off-by: bai <v@gor.io>
```
  191e3fda
- [Core] Label torch trace logging overhead with dynamo_timed (#39329) · b9cf629b
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  b9cf629b
- [EPLB] Refactor Async EPLB synchronization logic (#37601) · 3461c8b0
  Sage Moore authored Apr 20, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  3461c8b0
- [MoE Refactor] Move the shared/fused expert output sum into MoERunnerBase (#35949) · 726efe17
  bnellnm authored Apr 20, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  726efe17
- [XPU] fix MoE triton backend in online fp8 quantization (#40109) · 59556265
  Yan Ma authored Apr 20, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  59556265
- Properly enable wvSplitK fp8 path for RDNA (#37712) · 3a30eaa1
  Hashem Hashemi authored Apr 20, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  3a30eaa1
- [ROCm] Add MLA dual RMS norm fusion (Q, KV) pass for DeepSeek/Kimi-K2 (#39242) · fb5635d3
  Rita Brugarolas authored Apr 20, 2026
```
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
```
  fb5635d3
- [Bug] Fix dcp error message (#40053) · b42e878e
  Wentao Ye authored Apr 20, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b42e878e
- [ROCm][Feature] Enable AITER MLA attention backend to work with Eagle3... · 7243e02a
  larryli2-amd authored Apr 20, 2026
```
[ROCm][Feature] Enable AITER MLA attention backend to work with Eagle3 speculative decoding on ROCm (#39616)
Signed-off-by: larryli2-amd <larryli2@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  7243e02a
- [CI][EPLB] Add Async EPLB end-to-end integration test to CI (#40168) · def8f522
  Sage Moore authored Apr 20, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  def8f522
- mxfp8 online quant move to new frontend (#40152) · 38fa87ca
  Vasiliy Kuznetsov authored Apr 20, 2026
```
Signed-off-by: Vasiliy Kuznetsov <vasiliy@meta.com>
```
  38fa87ca
- [bugfix] Use only onlines CPUs in lscpu (#40161) · a023edfa
  Galigator authored Apr 20, 2026
```
Signed-off-by: kse <kevin.sejourne@cloud-temple.com>
Co-authored-by: kse <kevin.sejourne@cloud-temple.com>
```
  a023edfa
- [Anthropic][Frontend] Added chat_template_kwargs to /v1/messages (#40125) · b82fc136
  aleksandaryanakiev authored Apr 20, 2026
```
Signed-off-by: Aleksandar Yanakiev <alexander.yanakiev@discretestack.com>
Co-authored-by: Aleksandar Yanakiev <alexander.yanakiev@discretestack.com>
```
  b82fc136
- [XPU] enable triton attention test on XPU by removing cuda device binding (#39627) · e06de7f0
  Yan Ma authored Apr 20, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  e06de7f0
- nixl refactor [2/N]: unify TpKVTopology + HeteroTPTransferConfig into TransferTopology (#39529) · cc3993b0
  zhanqiuhu authored Apr 20, 2026
```
Signed-off-by: Zhanqiu Hu <zhu@redhat.com>
```
  cc3993b0
- [EPLB] Add nixl-based eplb communicator (#36276) · 50dd4cb4
  Ilya Markov authored Apr 20, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Markov Ilya <markovilya19@gmail.com>
```
  50dd4cb4
- [kv_offload+HMA][4/N]: Support sliding window lookup (#36645) · f774ba02
  Or Ozeri authored Apr 20, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  f774ba02
- [CPU][BugFix] Fix inter-node pipeline parallel (#40150) · 2aab9acf
  Fadi Arafeh authored Apr 20, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  2aab9acf
- [Bugfix] Fix scaled_mm output narrowing for 3D input tensors (#38093) · 58631d7c
  nemanjaudovic authored Apr 20, 2026
```
Signed-off-by: nemanjaudovic <nudovic@amd.com>
```
  58631d7c
- [ROCm][CI] Introducing new MI300 nodes (#39531) · a943839e
  Andreas Karatzas authored Apr 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  a943839e
- [Docs] Fix thinking_token_budget docs (#40316) · 6d8b8080
  milesial authored Apr 20, 2026
```
Signed-off-by: milesial <milesial@users.noreply.github.com>
```
  6d8b8080
- [Bugfix] Forward mm_processor_kwargs in offline generate APIs (#40251) · 77fd2c86
  wuyingjun authored Apr 20, 2026
```
Signed-off-by: wuyingjun <wuyingjun_yewu@cmss.chinamobile.com>
```
  77fd2c86
- [Fix] Add Spacing when Requesting Output Token > max_model_len (#40324) · e729cc82
  San-Nguyen authored Apr 20, 2026
```
Signed-off-by: San-Nguyen <san.nguyen@ibm.com>
```
  e729cc82
- [CPU][RISC-V] Support multiple RVV VLEN targets via compile-time dispatch (#39478) · ec7aafc0
  velonica0 authored Apr 20, 2026
```
Signed-off-by: velonica0 <like@mail.nankai.edu.cn>
```
  ec7aafc0
- [BUGFIX] Fix Pixtral consolidated format vision weight loading (#39916) · 6097afb9
  Julien Denize authored Apr 20, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  6097afb9
- [XPU] [torch.compile] Skipping CUDA graph memory estimation to avoid startup errors. (#39977) · 4f4713f9
  Chaojun Zhang authored Apr 20, 2026
```
Signed-off-by: chaojun-zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  4f4713f9
- [Qwen][Bugfix] Fixes sigmoid activation in torch impl of RMSNormGated. (#40245) · 89361181
  Tao He authored Apr 20, 2026
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  89361181
- fix: Do not make function calls when request has no tools for /v1/responses (#40314) · 67ed01c3
  Yuan Tang authored Apr 20, 2026
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  67ed01c3
- [Bugfix][Responses API] Fix streaming tool calls on /v1/responses (#39892) · 6e10cb54
  Hoang Nguyen authored Apr 20, 2026
```
Signed-off-by: Hoang Nguyen <118159510+hnt2601@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  6e10cb54
- [Bugfix] Properly initialize `PerTensorScaleParameter` for fused-on-disk checkpoints (#39765) · fcb31c1a
  Shinichi Hemmi authored Apr 20, 2026
```
Signed-off-by: Hemmi Shinichi <shemmi@preferred.jp>
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  fcb31c1a
- [Doc] Fix typos in token_embed pooling documentation (#40266) · d886c26d
  Lxx authored Apr 19, 2026
```
Signed-off-by: YifanLi3 <lyfqlx3@gmail.com>
```
  d886c26d
- [BugFix][XPU] fix lora ops bgmv_expand size not match (#39989) · 898beca5
  Liangliang Ma authored Apr 20, 2026
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  898beca5
19 Apr, 2026 2 commits
- [ci] Make ecr authenticate non blocking (#40305) · 629d45ea
  Kevin H. Luu authored Apr 19, 2026
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
```
  629d45ea
- [ROCm] Fix cu_seqlens_q off-by-one in AITER FA speculative decode path (#39120) · f150107e
  Andrew Barnes authored Apr 19, 2026
```
Signed-off-by: Bortlesboat <bortstheboat@gmail.com>
```
  f150107e