Commits · fe85a92e86211d066b07aba2a2a86640f70458d7 · OpenDAS / vllm_cscc

24 Apr, 2026 4 commits
- [Core] Avoid seq_lens_cpu GPU->CPU sync (#40654) · fe85a92e
  Nick Hill authored Apr 23, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  fe85a92e
- [EPLB] Remove asyncio infrastructure from Async EPLB (#40730) · 62b1bbe4
  Sage Moore authored Apr 23, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  62b1bbe4
- [ROCm] Cast score correction bias tensor during model construction for DeepSeek/Kimi-K2 (#39999) · fa4b7055
  Hemanth Acharya authored Apr 24, 2026
```
Signed-off-by: Hemanth Acharya <heachary@amd.com>
```
  fa4b7055
- [MoE] Move remaining PrepareAndFinalize to prepare finalize folder (#39009) · 447c372a
  Jackmin801 authored Apr 23, 2026
```
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>
```
  447c372a
23 Apr, 2026 24 commits

[Docs]Add documentation for bench serve visualization arguments (#40539) · ff2c2bd8

Sophie du Couédic authored Apr 24, 2026


Signed-off-by: Sophie du Couédic <sop@zurich.ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ff2c2bd8

[Spec Decode] Move `SpecDecodeBaseProposer` out of `eagle.py` (#40732) · cde8d247
Matthew Bonanni authored Apr 23, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
cde8d247
[Bugfix] Fix DeepSeek V2-Lite Accuracy drop (#40673) · 4a6dd1c3
bnellnm authored Apr 23, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
4a6dd1c3

[Bugfix] Fix workspace resize leaking reserved GPU memory (#39226) · 7ff65b19

czhu-cohere authored Apr 23, 2026


Signed-off-by: root <conway.zhu@cohere.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

7ff65b19

[MoE] Move xpu moe to fused_moe/experts/ (#40568) · 1b1c01de

Jackmin801 authored Apr 23, 2026


Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

1b1c01de

[DP][Ray] Pin DP control bundle to same node as first GPU bundle (#39167) · e9ba519f

shaharmor98 authored Apr 23, 2026

Signed-off-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

e9ba519f

[kv_offload+HMA][10/N]: Support load with multiple KV groups (#39402) · 5ef33ab2
Or Ozeri authored Apr 23, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
5ef33ab2

[MoE Refactor] Rename FusedMoE.make_expert_params_mapping to... · 1c2c1eb8

bnellnm authored Apr 23, 2026


[MoE Refactor] Rename FusedMoE.make_expert_params_mapping to fused_moe_make_expert_params_mapping (#40671)
Signed-off-by: Bill Nell <bnell@redhat.com>

1c2c1eb8

[ROCm] Implement GPU-to-NUMA-node detection (#40015) · 0098db9e

pschlan-amd authored Apr 23, 2026


Signed-off-by: Patrick Schlangen <pschlan@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

0098db9e

[Bugfix] Make Attention Backend Auto-Selection Batch-Invariance-Aware (#40193) · b7a26050

Srreyansh Sethi authored Apr 23, 2026


Signed-off-by: Srreyansh Sethi <srreyansh.sethi@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

b7a26050

[Model] Support Hy3 preview (#40681) · d0009ddb

stevenkuang authored Apr 23, 2026


Signed-off-by: stevenkuang <stevenkuang@tencent.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

d0009ddb

[Bugfix] Include inductor and functorch configs in compilation cache key (#40627) · 424033f4
Richard Zou authored Apr 23, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
424033f4
[Misc] use model arch converter for bidi models identification (#40701) · da1e7311
Isotr0py authored Apr 23, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
da1e7311
[Compilation] Refactor SiluMul activation+quant Fusion Pass (#39684) · 2196bac1
BadrBasowid authored Apr 23, 2026
```
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
```
2196bac1

[Build] Switch default CUDA to 13.0, update CUDA architecture lists, clean up... · 3ed5231c

Shengqi Chen authored Apr 23, 2026


[Build] Switch default CUDA to 13.0, update CUDA architecture lists, clean up stale build-args (#39878)
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

3ed5231c

[Misc] Support Human-readable (k/K/m/M..) json cli arg (#40473) · 9c2492e5
Nicolò Lucchesi authored Apr 23, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
9c2492e5
[MM][CG] Support `--enable-vit-cuda-graph` option for VLM examples (#40580) · fe57be78
Shanshan Shen authored Apr 23, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
fe57be78

[Responses] Add tool_choice/tools validation to match OpenAI behavior (#40399) · 8317cedc

Flora Feng authored Apr 23, 2026


Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

8317cedc

[compile] Skip FX graph deserialiaztion on loading, further reducing warm compile time. (#40151) · 98a242ff
Zhengxu Chen authored Apr 23, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
98a242ff

[MoE refactor] refactor GPTQMarlinMoEMethod with MK (#37990) · e4ee48da

Kunshang Ji authored Apr 23, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>

e4ee48da

[BugFix]fix Qwen3 MoE call gate twice (#40664) · 342c58bc
Kunshang Ji authored Apr 23, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
342c58bc

[TurboQuant] enable FA3/FA4 for prefill paths (#40092) · fe9c3d6c

Julian Huang authored Apr 23, 2026


Signed-off-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Codex <codex@openai.com>

fe9c3d6c

[XPU] disable fusion pattern support on XPU platform (#39789) · ccaf5ffa

Chaojun Zhang authored Apr 23, 2026


Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

ccaf5ffa

[BE] Fix compile time message to be consistent (use monitoring) (#40641) · 0283f303
Lucas Kabela authored Apr 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
0283f303

22 Apr, 2026 12 commits

[Fix][MoRI] Align MoRI-IO message format with P2pNcclConnector and vllm-router (#39565) · ac58e2a1
Simon Danielsson authored Apr 23, 2026
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Matvei Pashkovskii <mpashkov@amd.com>
```
ac58e2a1
[gRPC] Add standard gRPC health checking (grpc.health.v1) for Kubernetes native probes (#38016) · 9c271f94
Honglin Cao authored Apr 22, 2026
```
Signed-off-by: Honglin Cao <Caohonglin317@hotmail.com>
```
9c271f94
[Bugfix][Torch 2.12] Fix batch_invariant test with allow_override for torch 2.12 upgrade (#40562) · 22fa63cf
Lucas Kabela authored Apr 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
22fa63cf

[Refactor] Clean up log once `scope="local"` (#40540) · 8f87eb46

Wentao Ye authored Apr 22, 2026

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8f87eb46

[Bugfix][Parser] Fix Mistral pre-v11 tool parser failing on trailing model output (#40531) · cfa49213

Doug Smith authored Apr 22, 2026


Signed-off-by: dougbtv <dosmith@redhat.com>
Signed-off-by: Doug Smith <dougbtv@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>

cfa49213

FlexAttention non-causal support (#40394) · 29f64c5f

Fynn Schmitt-Ulms authored Apr 22, 2026


Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

29f64c5f

Fix test_startup.py for torch 2.12 (#40636) · eb6661d5
Angela Yi authored Apr 22, 2026
```
Signed-off-by: Angela Yi <yiangela7@gmail.com>
```
eb6661d5

[NVFP4] NVFP4 MOE emulation fallback for H100/MI300/MI350, standardize... · d622e27d

fxmarty-amd authored Apr 22, 2026


[NVFP4] NVFP4 MOE emulation fallback for H100/MI300/MI350, standardize `TritonExperts` usage for OCP MX emulation (#35737)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>

d622e27d

[MoE] Convert CT W8A8 To Oracle Structure (#39187) · 5f76b3fb

Robert Shaw authored Apr 22, 2026


Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>

5f76b3fb

[MoE Refactor] Combine MoERunnerBase + DefaultMoERunner (#40560) · 809d83c2
bnellnm authored Apr 22, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
809d83c2
[xpu][rocm] Update `current_platform.supports_fp8()` for TritonExperts (#40132) · a4905133
Hank_ authored Apr 22, 2026
```
Signed-off-by: Hank <hcc.mayday@gmail.com>
```
a4905133

[Bugfix] LoRA for DeepSeek V3.2 (#35077) · a250f1bd

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Apr 22, 2026


Signed-off-by: Hollow Man <hollowman@opensuse.org>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a250f1bd