Commits · c075702eaee56ca2f4a315e742f3c89f5e4c6e71 · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "6ecba840d7c301899f87cda40921239482e65185"

20 Apr, 2026 33 commits
- [Misc][UX] Suppress confusing `num_gpu_blocks` log lines (#40402) · c075702e
  Matthew Bonanni authored Apr 20, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
  c075702e
- [ROCm] Hotfix: guard MLA dual RMS norm fusion against older AITer versions (#40386) · 21b086d0
  Rita Brugarolas authored Apr 20, 2026
```
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
```
  21b086d0
- [EPLB] Consolidate is_unchanged/is_received_locally into TransferMetadata (#37341) · 3173441b
  Sage Moore authored Apr 20, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  3173441b
- [LMCache MP Connector] Add num_lmcache_extra_cached_token in KVTransferParams (#39843) · 8b1f3beb
  Cao Qian authored Apr 20, 2026
```
Signed-off-by: aeon-x <talexcao@gmail.com>
```
  8b1f3beb
- [Core] Cache InductorPass.hash_source with functools.cache (#39328) · 87805fa1
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  87805fa1
- [WideEP] Remove naive all2all. Use allgather_reducescatter instead (#33728) · 81d954f4
  Tyler Michael Smith authored Apr 20, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  81d954f4
- [Core] Pass donate_graph_module=True to standalone_compile (#39733) · 47fcb8ca
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  47fcb8ca
- Update flashinfer to 0.6.8 (#39959) · 191e3fda
  bai authored Apr 20, 2026
```
Signed-off-by: bai <v@gor.io>
```
  191e3fda
- [Core] Label torch trace logging overhead with dynamo_timed (#39329) · b9cf629b
  Frederik Gossen authored Apr 20, 2026
```
Signed-off-by: Frederik Gossen <frgossen@meta.com>
```
  b9cf629b
- [EPLB] Refactor Async EPLB synchronization logic (#37601) · 3461c8b0
  Sage Moore authored Apr 20, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  3461c8b0
- [MoE Refactor] Move the shared/fused expert output sum into MoERunnerBase (#35949) · 726efe17
  bnellnm authored Apr 20, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  726efe17
- [XPU] fix MoE triton backend in online fp8 quantization (#40109) · 59556265
  Yan Ma authored Apr 20, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  59556265
- Properly enable wvSplitK fp8 path for RDNA (#37712) · 3a30eaa1
  Hashem Hashemi authored Apr 20, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  3a30eaa1
- [ROCm] Add MLA dual RMS norm fusion (Q, KV) pass for DeepSeek/Kimi-K2 (#39242) · fb5635d3
  Rita Brugarolas authored Apr 20, 2026
```
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
```
  fb5635d3
- [Bug] Fix dcp error message (#40053) · b42e878e
  Wentao Ye authored Apr 20, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b42e878e
- [ROCm][Feature] Enable AITER MLA attention backend to work with Eagle3... · 7243e02a
  larryli2-amd authored Apr 20, 2026
```
[ROCm][Feature] Enable AITER MLA attention backend to work with Eagle3 speculative decoding on ROCm (#39616)
Signed-off-by: larryli2-amd <larryli2@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  7243e02a
- mxfp8 online quant move to new frontend (#40152) · 38fa87ca
  Vasiliy Kuznetsov authored Apr 20, 2026
```
Signed-off-by: Vasiliy Kuznetsov <vasiliy@meta.com>
```
  38fa87ca
- [bugfix] Use only onlines CPUs in lscpu (#40161) · a023edfa
  Galigator authored Apr 20, 2026
```
Signed-off-by: kse <kevin.sejourne@cloud-temple.com>
Co-authored-by: kse <kevin.sejourne@cloud-temple.com>
```
  a023edfa
- [Anthropic][Frontend] Added chat_template_kwargs to /v1/messages (#40125) · b82fc136
  aleksandaryanakiev authored Apr 20, 2026
```
Signed-off-by: Aleksandar Yanakiev <alexander.yanakiev@discretestack.com>
Co-authored-by: Aleksandar Yanakiev <alexander.yanakiev@discretestack.com>
```
  b82fc136
- nixl refactor [2/N]: unify TpKVTopology + HeteroTPTransferConfig into TransferTopology (#39529) · cc3993b0
  zhanqiuhu authored Apr 20, 2026
```
Signed-off-by: Zhanqiu Hu <zhu@redhat.com>
```
  cc3993b0
- [EPLB] Add nixl-based eplb communicator (#36276) · 50dd4cb4
  Ilya Markov authored Apr 20, 2026
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Markov Ilya <markovilya19@gmail.com>
```
  50dd4cb4
- [kv_offload+HMA][4/N]: Support sliding window lookup (#36645) · f774ba02
  Or Ozeri authored Apr 20, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  f774ba02
- [CPU][BugFix] Fix inter-node pipeline parallel (#40150) · 2aab9acf
  Fadi Arafeh authored Apr 20, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  2aab9acf
- [Bugfix] Fix scaled_mm output narrowing for 3D input tensors (#38093) · 58631d7c
  nemanjaudovic authored Apr 20, 2026
```
Signed-off-by: nemanjaudovic <nudovic@amd.com>
```
  58631d7c
- [Bugfix] Forward mm_processor_kwargs in offline generate APIs (#40251) · 77fd2c86
  wuyingjun authored Apr 20, 2026
```
Signed-off-by: wuyingjun <wuyingjun_yewu@cmss.chinamobile.com>
```
  77fd2c86
- [Fix] Add Spacing when Requesting Output Token > max_model_len (#40324) · e729cc82
  San-Nguyen authored Apr 20, 2026
```
Signed-off-by: San-Nguyen <san.nguyen@ibm.com>
```
  e729cc82
- [BUGFIX] Fix Pixtral consolidated format vision weight loading (#39916) · 6097afb9
  Julien Denize authored Apr 20, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: juliendenize <julien.denize@mistral.ai>
```
  6097afb9
- [XPU] [torch.compile] Skipping CUDA graph memory estimation to avoid startup errors. (#39977) · 4f4713f9
  Chaojun Zhang authored Apr 20, 2026
```
Signed-off-by: chaojun-zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  4f4713f9
- [Qwen][Bugfix] Fixes sigmoid activation in torch impl of RMSNormGated. (#40245) · 89361181
  Tao He authored Apr 20, 2026
```
Signed-off-by: Tao He <linzhu.ht@alibaba-inc.com>
```
  89361181
- fix: Do not make function calls when request has no tools for /v1/responses (#40314) · 67ed01c3
  Yuan Tang authored Apr 20, 2026
```
Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
```
  67ed01c3
- [Bugfix][Responses API] Fix streaming tool calls on /v1/responses (#39892) · 6e10cb54
  Hoang Nguyen authored Apr 20, 2026
```
Signed-off-by: Hoang Nguyen <118159510+hnt2601@users.noreply.github.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
  6e10cb54
- [Bugfix] Properly initialize `PerTensorScaleParameter` for fused-on-disk checkpoints (#39765) · fcb31c1a
  Shinichi Hemmi authored Apr 20, 2026
```
Signed-off-by: Hemmi Shinichi <shemmi@preferred.jp>
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  fcb31c1a
- [BugFix][XPU] fix lora ops bgmv_expand size not match (#39989) · 898beca5
  Liangliang Ma authored Apr 20, 2026
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  898beca5
19 Apr, 2026 7 commits
- [ROCm] Fix cu_seqlens_q off-by-one in AITER FA speculative decode path (#39120) · f150107e
  Andrew Barnes authored Apr 19, 2026
```
Signed-off-by: Bortlesboat <bortstheboat@gmail.com>
```
  f150107e
- Fix MoE backend selection for LoRA (unquantized MoE) (#40273) · d1135a50
  danisereb authored Apr 19, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  d1135a50
- Optimize nemotron VL image/video preprocessing (#40283) · 982beae8
  Netanel Haber authored Apr 19, 2026
```
Signed-off-by: milesial <milesial@users.noreply.github.com>
Co-authored-by: milesial <milesial@users.noreply.github.com>
```
  982beae8
- [FEAT] [Perf] [Gemma4] Fused Gemma4 Routing Function Triton (#39083) · 45232a45
  TJian authored Apr 19, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  45232a45
- [Bugfix] Kimi-K2 tool parser streaming - fix token leakage, argument... · 03ce1c6e
  Flora Feng authored Apr 19, 2026
```
[Bugfix] Kimi-K2 tool parser streaming - fix token leakage, argument truncation, and content dropping (#38579)
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  03ce1c6e
- [KV Offload] Pass request context (#39185) · 4353c9cb
  omerpaz95 authored Apr 19, 2026
```
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
```
  4353c9cb
- [KV Connector] Allow metrics of multiple connectors of same types in multi connector. (#40010) · 4b7f5ea1
  omerpaz95 authored Apr 19, 2026
```
Signed-off-by: omerpaz95 <omerpaz95@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  4b7f5ea1