Commits · 53ecc807c0e323aea2f2a48dfdae71be838c4f5c · OpenDAS / vllm_cscc

23 Apr, 2026 20 commits
- [XPU] Upgrade torch 2.11 for xpu (#37947) · 53ecc807
  Kunshang Ji authored Apr 23, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ecc807
- [Bugfix] Make Attention Backend Auto-Selection Batch-Invariance-Aware (#40193) · b7a26050
  Srreyansh Sethi authored Apr 23, 2026
```
Signed-off-by: Srreyansh Sethi <srreyansh.sethi@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
  b7a26050
- [Model] Support Hy3 preview (#40681) · d0009ddb
  stevenkuang authored Apr 23, 2026
```
Signed-off-by: stevenkuang <stevenkuang@tencent.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  d0009ddb
- [Bugfix] Include inductor and functorch configs in compilation cache key (#40627) · 424033f4
  Richard Zou authored Apr 23, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  424033f4
- [Misc] use model arch converter for bidi models identification (#40701) · da1e7311
  Isotr0py authored Apr 23, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  da1e7311
- [XPU][CI]Temporary disable 3 cases on Intel GPU in CI (#40683) · 01cb41dc
  xiangdong authored Apr 23, 2026
```
Signed-off-by: zengxian <xiangdong.zeng@intel.com>
```
  01cb41dc
- [CPU] Added faster exp routine for lower precision data types. (#38112) · 2f314bc5
  almayne authored Apr 23, 2026
```
Signed-off-by: Anna Mayne <anna.mayne@arm.com>
Co-authored-by: Fadi Arafeh <fadi.arafeh@arm.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  2f314bc5
- [Compilation] Refactor SiluMul activation+quant Fusion Pass (#39684) · 2196bac1
  BadrBasowid authored Apr 23, 2026
```
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
```
  2196bac1
- [ROCm] Add gfx1102/gfx1103 support (#40037) · 4b7869d6
  Matthias Gehre authored Apr 23, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  4b7869d6
- [UT][Hardware] let torchrun example tests use the default backend (#39879) · 4a79262e
  liuzhenwei authored Apr 23, 2026
```
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
```
  4a79262e
- [Build] Switch default CUDA to 13.0, update CUDA architecture lists, clean up... · 3ed5231c
  Shengqi Chen authored Apr 23, 2026
```
[Build] Switch default CUDA to 13.0, update CUDA architecture lists, clean up stale build-args (#39878)
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  3ed5231c
- [Misc] Support Human-readable (k/K/m/M..) json cli arg (#40473) · 9c2492e5
  Nicolò Lucchesi authored Apr 23, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  9c2492e5
- [MM][CG] Support `--enable-vit-cuda-graph` option for VLM examples (#40580) · fe57be78
  Shanshan Shen authored Apr 23, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  fe57be78
- [Responses] Add tool_choice/tools validation to match OpenAI behavior (#40399) · 8317cedc
  Flora Feng authored Apr 23, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
  8317cedc
- [compile] Skip FX graph deserialiaztion on loading, further reducing warm compile time. (#40151) · 98a242ff
  Zhengxu Chen authored Apr 23, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  98a242ff
- [MoE refactor] refactor GPTQMarlinMoEMethod with MK (#37990) · e4ee48da
  Kunshang Ji authored Apr 23, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>
```
  e4ee48da
- [BugFix]fix Qwen3 MoE call gate twice (#40664) · 342c58bc
  Kunshang Ji authored Apr 23, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  342c58bc
- [TurboQuant] enable FA3/FA4 for prefill paths (#40092) · fe9c3d6c
  Julian Huang authored Apr 23, 2026
```
Signed-off-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Codex <codex@openai.com>
```
  fe9c3d6c
- [XPU] disable fusion pattern support on XPU platform (#39789) · ccaf5ffa
  Chaojun Zhang authored Apr 23, 2026
```
Signed-off-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  ccaf5ffa
- [BE] Fix compile time message to be consistent (use monitoring) (#40641) · 0283f303
  Lucas Kabela authored Apr 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  0283f303
22 Apr, 2026 20 commits

[Fix][MoRI] Align MoRI-IO message format with P2pNcclConnector and vllm-router (#39565) · ac58e2a1
Simon Danielsson authored Apr 23, 2026
```
Signed-off-by: simondanielsson <simon.danielsson99@hotmail.com>
Co-authored-by: Matvei Pashkovskii <mpashkov@amd.com>
```
ac58e2a1
[Bugfix] Fix RMS norm + quant fusion on DeepGEMM UE8M0 path for B200 (#40552) · b8401a9b
Lucas Kabela authored Apr 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
b8401a9b
[gRPC] Add standard gRPC health checking (grpc.health.v1) for Kubernetes native probes (#38016) · 9c271f94
Honglin Cao authored Apr 22, 2026
```
Signed-off-by: Honglin Cao <Caohonglin317@hotmail.com>
```
9c271f94
[Bugfix][Torch 2.12] Fix batch_invariant test with allow_override for torch 2.12 upgrade (#40562) · 22fa63cf
Lucas Kabela authored Apr 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
22fa63cf

[Refactor] Clean up log once `scope="local"` (#40540) · 8f87eb46

Wentao Ye authored Apr 22, 2026

Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

8f87eb46

[Bugfix][Parser] Fix Mistral pre-v11 tool parser failing on trailing model output (#40531) · cfa49213

Doug Smith authored Apr 22, 2026


Signed-off-by: dougbtv <dosmith@redhat.com>
Signed-off-by: Doug Smith <dougbtv@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>

cfa49213

FlexAttention non-causal support (#40394) · 29f64c5f

Fynn Schmitt-Ulms authored Apr 22, 2026


Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

29f64c5f

Fix test_startup.py for torch 2.12 (#40636) · eb6661d5
Angela Yi authored Apr 22, 2026
```
Signed-off-by: Angela Yi <yiangela7@gmail.com>
```
eb6661d5

[NVFP4] NVFP4 MOE emulation fallback for H100/MI300/MI350, standardize... · d622e27d

fxmarty-amd authored Apr 22, 2026


[NVFP4] NVFP4 MOE emulation fallback for H100/MI300/MI350, standardize `TritonExperts` usage for OCP MX emulation (#35737)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>

d622e27d

[MoE] Convert CT W8A8 To Oracle Structure (#39187) · 5f76b3fb

Robert Shaw authored Apr 22, 2026


Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>

5f76b3fb

[MoE Refactor] Combine MoERunnerBase + DefaultMoERunner (#40560) · 809d83c2
bnellnm authored Apr 22, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
809d83c2

[Bugfix][CI] Fix... · 33ef1941

Nicolò Lucchesi authored Apr 22, 2026


[Bugfix][CI] Fix `v1/kv_connector/unit/test_nixl_connector_hma.py::test_fewer_blocks_with_hma` (#40597)
Signed-off-by: NickLucche <nlucches@redhat.com>

33ef1941

[xpu][rocm] Update `current_platform.supports_fp8()` for TritonExperts (#40132) · a4905133
Hank_ authored Apr 22, 2026
```
Signed-off-by: Hank <hcc.mayday@gmail.com>
```
a4905133

[Doc] Clarify supported keys for --speculative-config (#40455) · ecbe42e9

xiao authored Apr 22, 2026


Signed-off-by: Wangxiaoxiaoa <Wangxiaoxiaoa@users.noreply.github.com>
Co-authored-by: Wangxiaoxiaoa <Wangxiaoxiaoa@users.noreply.github.com>

ecbe42e9

[Bugfix] LoRA for DeepSeek V3.2 (#35077) · a250f1bd

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Apr 22, 2026


Signed-off-by: Hollow Man <hollowman@opensuse.org>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a250f1bd

[Bugfix][CPU][RISC-V] Clamp exp() input to prevent NaN (#40428) · 04eac6ba
lyd1992 authored Apr 22, 2026
```
Signed-off-by: liuyudong <liuyudong@iscas.ac.cn>
```
04eac6ba

support hotwords for FunASR model (#39674) · 9047288b

AllenDou authored Apr 22, 2026


Signed-off-by: zixiao <shunli.dsl@alibaba-inc.com>
Co-authored-by: zixiao <shunli.dsl@alibaba-inc.com>

9047288b

upgrade tpu-inference to v0.18.0 (#40395) · ed6d3037
Johnny Yang authored Apr 22, 2026

ed6d3037

[Multimodal] Support custom video metadata for pre-extracted frame sequences (#40133) · 6aa057c9

storyicon authored Apr 22, 2026


Signed-off-by: storyicon <storyicon@foxmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

6aa057c9

[Bugfix] [Reasoning] Add reasoning_start_str/reasoning_end_str properties to... · a2bd09c9

Chauncey authored Apr 22, 2026


[Bugfix] [Reasoning] Add reasoning_start_str/reasoning_end_str properties to reasoning parsers (#40566)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

a2bd09c9