Commits · 333529deae59cd4100df540f225470c9bc539bee · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "f4f4e7ef273645192fac837718b3fdcf073c597a"

24 Apr, 2026 12 commits

[EPLB] Fix replica selection bias in fused_moe router (#40810) · 333529de
Artem Perevedentsev authored Apr 25, 2026
```
Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com>
```
333529de

[Bugfix][CI] Fix wrong residual shape in TestFusedAddRMSNorm.example_inputs... · 88256082

Zhang Jian authored Apr 25, 2026


[Bugfix][CI] Fix wrong residual shape in TestFusedAddRMSNorm.example_inputs that causes flaky test (#40629)
Signed-off-by: Zhang Jian <jianmusings@gmail.com>

88256082

[CI/Build] Add e2e test for ViT CUDA graph (#40780) · b5587e10
Shanshan Shen authored Apr 24, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
b5587e10
[MoE] Move cutlass moe to fused_moe/experts/ (#40574) · 079a4cf3
Jackmin801 authored Apr 23, 2026
```
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
079a4cf3

[Deprecate] Deprecate LLM.reward offline api, use LLM.encode instead. (#40688) · 9744b699

wang.yuqi authored Apr 24, 2026


Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

9744b699

[Bugfix] Avoid mutating `chat_template_kwargs` in `HYV3ReasoningParser` initialization (#40713) · c662b435

Bugen Zhao authored Apr 24, 2026


Signed-off-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c662b435

[BUG]: fix HF tokenizer concurrent borrow in tool parsers (#40059) · c9bf77df

yzong-rh authored Apr 23, 2026


Signed-off-by: Yifan <yzong@redhat.com>
Co-authored-by: timon0305 <timon0305@outlook.com>
Co-authored-by: sfeng33 <4florafeng@gmail.com>

c9bf77df

[Bugfix] Treat <tool_call> as implicit reasoning end in Qwen3 parser (#35687) · 92762edc
Doug Campos authored Apr 23, 2026
```
Signed-off-by: Doug Campos <qmx@qmx.me>
```
92762edc

[Feat] Unified Synthetic Acceptance Rate for V1 and V2 (#40662) · 626daa20

Benjamin Chislett authored Apr 23, 2026

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

626daa20

[Core] Avoid seq_lens_cpu GPU->CPU sync (#40654) · fe85a92e
Nick Hill authored Apr 23, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
fe85a92e
[EPLB] Remove asyncio infrastructure from Async EPLB (#40730) · 62b1bbe4
Sage Moore authored Apr 23, 2026
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
62b1bbe4

[MoE] Move remaining PrepareAndFinalize to prepare finalize folder (#39009) · 447c372a

Jackmin801 authored Apr 23, 2026


Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>

447c372a

23 Apr, 2026 9 commits
- [Spec Decode] Move `SpecDecodeBaseProposer` out of `eagle.py` (#40732) · cde8d247
  Matthew Bonanni authored Apr 23, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  cde8d247
- [CI] Split disaggregated tests into own test-area (#40623) · 8824f50f
  Nicolò Lucchesi authored Apr 23, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  8824f50f
- [Model] Support Hy3 preview (#40681) · d0009ddb
  stevenkuang authored Apr 23, 2026
```
Signed-off-by: stevenkuang <stevenkuang@tencent.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  d0009ddb
- [Bugfix] Include inductor and functorch configs in compilation cache key (#40627) · 424033f4
  Richard Zou authored Apr 23, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  424033f4
- [Compilation] Refactor SiluMul activation+quant Fusion Pass (#39684) · 2196bac1
  BadrBasowid authored Apr 23, 2026
```
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
```
  2196bac1
- [UT][Hardware] let torchrun example tests use the default backend (#39879) · 4a79262e
  liuzhenwei authored Apr 23, 2026
```
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
```
  4a79262e
- [Misc] Support Human-readable (k/K/m/M..) json cli arg (#40473) · 9c2492e5
  Nicolò Lucchesi authored Apr 23, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  9c2492e5
- [Responses] Add tool_choice/tools validation to match OpenAI behavior (#40399) · 8317cedc
  Flora Feng authored Apr 23, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
```
  8317cedc
- [TurboQuant] enable FA3/FA4 for prefill paths (#40092) · fe9c3d6c
  Julian Huang authored Apr 23, 2026
```
Signed-off-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: Codex <codex@openai.com>
```
  fe9c3d6c
22 Apr, 2026 16 commits

[Bugfix] Fix RMS norm + quant fusion on DeepGEMM UE8M0 path for B200 (#40552) · b8401a9b
Lucas Kabela authored Apr 22, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
b8401a9b
[gRPC] Add standard gRPC health checking (grpc.health.v1) for Kubernetes native probes (#38016) · 9c271f94
Honglin Cao authored Apr 22, 2026
```
Signed-off-by: Honglin Cao <Caohonglin317@hotmail.com>
```
9c271f94

[Bugfix][Parser] Fix Mistral pre-v11 tool parser failing on trailing model output (#40531) · cfa49213

Doug Smith authored Apr 22, 2026


Signed-off-by: dougbtv <dosmith@redhat.com>
Signed-off-by: Doug Smith <dougbtv@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Flora Feng <4florafeng@gmail.com>

cfa49213

FlexAttention non-causal support (#40394) · 29f64c5f

Fynn Schmitt-Ulms authored Apr 22, 2026


Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

29f64c5f

Fix test_startup.py for torch 2.12 (#40636) · eb6661d5
Angela Yi authored Apr 22, 2026
```
Signed-off-by: Angela Yi <yiangela7@gmail.com>
```
eb6661d5

[NVFP4] NVFP4 MOE emulation fallback for H100/MI300/MI350, standardize... · d622e27d

fxmarty-amd authored Apr 22, 2026


[NVFP4] NVFP4 MOE emulation fallback for H100/MI300/MI350, standardize `TritonExperts` usage for OCP MX emulation (#35737)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>

d622e27d

[Bugfix][CI] Fix... · 33ef1941

Nicolò Lucchesi authored Apr 22, 2026


[Bugfix][CI] Fix `v1/kv_connector/unit/test_nixl_connector_hma.py::test_fewer_blocks_with_hma` (#40597)
Signed-off-by: NickLucche <nlucches@redhat.com>

33ef1941

[Bugfix] LoRA for DeepSeek V3.2 (#35077) · a250f1bd

ℍ𝕠𝕝𝕝𝕠𝕨 𝕄𝕒𝕟 authored Apr 22, 2026


Signed-off-by: Hollow Man <hollowman@opensuse.org>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

a250f1bd

[Model] Add block-local attention and YaRN for local layers to Gemma3 (#39823) · 12367487
philip-essential authored Apr 21, 2026
```
Signed-off-by: Philip Monk <169196560+philip-essential@users.noreply.github.com>
```
12367487
[fix] flaky test_mla_attn_quant_fusion.py (#40530) · 4254aeb5
Carl Y authored Apr 21, 2026
```
Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
```
4254aeb5

[kv_offload+HMA][8/N]: Support multi-group worker transfer (#38453) · aad88f84

Or Ozeri authored Apr 22, 2026


Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

aad88f84

[compile] mla + group fp8 fusion (#38877) · 4506319a

Carl Y authored Apr 21, 2026


Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

4506319a

[Multimodal] Add PyAV video backend for concurrent video decoding (#39986) · 6f2c71be

Jaseel Muhammad authored Apr 22, 2026


Signed-off-by: Jaseel Muhammad <jaseel.muhammad@mbzuai.ac.ae>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

6f2c71be

[AMD][CI][BugFix] Override normalize_e4m3fn_to_e4m3fnuz for fnuz machines in... · 2463f00f

rasmith authored Apr 21, 2026


[AMD][CI][BugFix] Override normalize_e4m3fn_to_e4m3fnuz for fnuz machines in test_moe_layer_no_parallel (#40550)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>