Commits · fa9e68022d29c5396dfbb96d13587b6bc1bdb933 · OpenDAS / vllm_cscc

03 Apr, 2026 17 commits
- Fix Nano Nemotron VL regressions (#38655) · fa9e6802
  Netanel Haber authored Apr 03, 2026
```
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
```
  fa9e6802
- [Misc] Clean up Gemma4 implementation (#38872) · 55064354
  Isotr0py authored Apr 03, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  55064354
- [MRV2][KVConnector] Fix missing build_connector_worker_meta (#38698) · 311c9816
  Yifan Qiao authored Apr 02, 2026
```
Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
```
  311c9816
- [CI/Build] Add audio deps in Dockerfile.cpu (#38876) · 21d7ecc5
  Li, Jiang authored Apr 03, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  21d7ecc5
- [Bug] Add e_score_correction_bias to SKIP_TENSORS (#38746) · 4729b908
  Aaron Hao authored Apr 02, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  4729b908
- full cudagraph for flex-attn (#36298) · 8b141ed8
  shunting314 authored Apr 02, 2026
```
Signed-off-by: shunting314 <shunting@meta.com>
```
  8b141ed8
- [Model] Add Phi4ForCausalLMV for microsoft/Phi-4-reasoning-vision-15B (#38306) · 2ad7c033
  Varun Sundar Rabindranath authored Apr 03, 2026
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  2ad7c033
- [CI][ROCm] Add Qwen3.5-35B-A3B-MXFP4 model eval into CI (#38664) · 201d2ea5
  Bowen Bao authored Apr 02, 2026
```
Signed-off-by: Bowen Bao <bowenbao@amd.com>
```
  201d2ea5
- [ROCm][Quantization][1/N] Refactor quark_moe w_mxfp4 w/ oracle (#38774) · 103f0de5
  Bowen Bao authored Apr 02, 2026
```
Signed-off-by: Bowen Bao <bowenbao@amd.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  103f0de5
- refactor hard coded device string in test files under tests/v1 and tests/lora (#37566) · 32e0c0bf
  wliao2 authored Apr 02, 2026
```
Signed-off-by: Liao, Wei <wei.liao@intel.com>
```
  32e0c0bf
- [Perf] Batch KV cache swap copies via cuMemcpyBatchAsync (#38460) · 4a06e124
  Itay Etelis authored Apr 03, 2026
```
Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  4a06e124
- [Kernel] Fuse FP8 output quantization into merge_attn_states (#36518) · 3bc2734d
  Carl Y authored Apr 02, 2026
```
Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
```
  3bc2734d
- [mla] Support fused FP8/NVFP4 output quantization in MLA attention (#35792) (#36205) · 1f5ec288
  Carl Y authored Apr 02, 2026
```
Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Signed-off-by: Carl Y <4531192+carlyou@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  1f5ec288
- [XPU] Initial support for GDN attention on Qwen3-next/Qwen3.5 (#33657) · ee3cf457
  Yan Ma authored Apr 03, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  ee3cf457
- [CI] Fix `test_nixl_connector` (#38838) · 05e68e1f
  Matthew Bonanni authored Apr 02, 2026
  
  05e68e1f
- [Bugfix] Fix NVFP4+MTP crash: force unquantized mtp.fc for Qwen3.5 (#38832) · 771913e4
  Vadim Gimpelson authored Apr 03, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  771913e4
- [New Model]: add support for telechat3 (#38510) · 71a9125c
  1096125073 authored Apr 03, 2026
```
Signed-off-by: xiayongqiang <xiayq1@chinatelecom.cn>
Co-authored-by: xiayongqiang <xiayq1@chinatelecom.cn>
```
  71a9125c
02 Apr, 2026 23 commits

[Kernel] Mamba support different layout for Conv state (#37416) · 66e86f1d
Nicolò Lucchesi authored Apr 03, 2026

66e86f1d
[Bugfix]: Fix Gemma4ToolParser.__init__() missing `tools` parameter (#38847) · bb39382b
Michael authored Apr 02, 2026
```
Signed-off-by: Michael Hospedales <hospedales@me.com>
```
bb39382b
[CI] Fix: pass string cache_dtype in test_register_kv_caches (#38836) · 7b743ba9
zhanqiuhu authored Apr 02, 2026

7b743ba9

[CI] Add flashinfer.py to attention test source deps (#38792) · 188defbd

Stefano Castagnetta authored Apr 02, 2026


Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

188defbd

feat(models): implement Google Gemma 4 architecture support (MoE, Multimodal,... · 08ed2b96

Luciano Martins authored Apr 02, 2026

feat(models): implement Google Gemma 4 architecture support (MoE, Multimodal, Reasoning, Tool-Use) (#38826)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Luciano Martins <lucianomartins@google.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

08ed2b96

Bump helion dependency from 0.3.2 to 0.3.3 (#38062) · ecd5443d

Yanan Cao authored Apr 02, 2026


Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

ecd5443d

[Bugfix] Fix test mocks after SM100 restriction in #38730 (#38791) · 58262dec
Stefano Castagnetta authored Apr 02, 2026
```
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
58262dec
[FA4] Update flash-attention to latest upstream FA4 (#38690) · cb3935a8
Lucas Wilkinson authored Apr 02, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
cb3935a8
[CI][ROCm] Add gpt-oss w4a8 in CI (#38292) · 82a006be
Bowen Bao authored Apr 02, 2026
```
Signed-off-by: Bowen Bao <bowenbao@amd.com>
```
82a006be
[Frontend] Re-enable running MaxSim on GPU (#38620) · a9b4f07b
wang.yuqi authored Apr 03, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
a9b4f07b

Triton MLA perf fixes (#33529) · d9408ffb

Koushik Dutta authored Apr 02, 2026


Signed-off-by: Koushik Dutta <koushd@gmail.com>
Co-authored-by: root <root@ubuntu-nvidia.localdomain>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

d9408ffb

[Bugfix] Enable batch-invariant Triton matmul on all Ampere GPUs (SM 8x) (#38427) · 16a65e41

Yusuf Mohammad authored Apr 02, 2026


Signed-off-by: yusuf <yusufmohammad@live.com>
Signed-off-by: yusuf <yusuf@deeplearningmachine.mynet>
Signed-off-by: Yusuf Mohammad <79484377+YM2132@users.noreply.github.com>
Signed-off-by: <>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: yusuf <yusuf@deeplearningmachine.mynet>

16a65e41

[Model] Add support for Cheers multimodal model (#38788) · c0817e4d

bsliu authored Apr 02, 2026


Signed-off-by: bsliu <1187291748@qq.com>
Signed-off-by: 吴炳贤 <wubingxian24@mails.ucas.ac.cn>

c0817e4d

Don't compile vision encoder for Transformers backend (#30518) · dfe5e316
Harry Mellor authored Apr 02, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
dfe5e316

[Feature] KV cache per-token-head INT8/FP8 quantization (#38378) · 2ce3d0ce

JartX authored Apr 02, 2026


Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: yangyang4991 <yangyang4991@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

2ce3d0ce

[Perf] fuse kernels in gdn (#37813) · 4eefbf96
Jiangyun Zhu authored Apr 02, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
4eefbf96

[ROCm] Enable VLLM triton FP8 moe for gfx1201, tuned for Qwen3-30B-A3B-FP8... · 551b3fb3

vllmellm authored Apr 02, 2026


[ROCm] Enable VLLM triton FP8 moe for gfx1201, tuned for Qwen3-30B-A3B-FP8 tp=2 and Qwen/Qwen3.5-35B-A3B-FP8 tp=2 (#38086)
Signed-off-by: big-yellow-duck <jeffaw99@hotmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>