Commits · 4a06e1246e30214d644a1732d6853cfe2b935a75 · OpenDAS / vllm_cscc

03 Apr, 2026 7 commits

[Perf] Batch KV cache swap copies via cuMemcpyBatchAsync (#38460) · 4a06e124

Itay Etelis authored Apr 03, 2026


Signed-off-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Itay Etelis <itay.etelis@ibm.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>

4a06e124

[Kernel] Fuse FP8 output quantization into merge_attn_states (#36518) · 3bc2734d
Carl Y authored Apr 02, 2026
```
Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
```
3bc2734d

[mla] Support fused FP8/NVFP4 output quantization in MLA attention (#35792) (#36205) · 1f5ec288

Carl Y authored Apr 02, 2026

Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Signed-off-by: Carl Y <4531192+carlyou@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

1f5ec288

[XPU] Initial support for GDN attention on Qwen3-next/Qwen3.5 (#33657) · ee3cf457

Yan Ma authored Apr 03, 2026


Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

ee3cf457

[CI] Fix `test_nixl_connector` (#38838) · 05e68e1f
Matthew Bonanni authored Apr 02, 2026

05e68e1f
[Bugfix] Fix NVFP4+MTP crash: force unquantized mtp.fc for Qwen3.5 (#38832) · 771913e4
Vadim Gimpelson authored Apr 03, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
771913e4

[New Model]: add support for telechat3 (#38510) · 71a9125c

1096125073 authored Apr 03, 2026


Signed-off-by: xiayongqiang <xiayq1@chinatelecom.cn>
Co-authored-by: xiayongqiang <xiayq1@chinatelecom.cn>

71a9125c

02 Apr, 2026 24 commits

[Kernel] Mamba support different layout for Conv state (#37416) · 66e86f1d
Nicolò Lucchesi authored Apr 03, 2026

66e86f1d
[Bugfix]: Fix Gemma4ToolParser.__init__() missing `tools` parameter (#38847) · bb39382b
Michael authored Apr 02, 2026
```
Signed-off-by: Michael Hospedales <hospedales@me.com>
```
bb39382b
[CI] Fix: pass string cache_dtype in test_register_kv_caches (#38836) · 7b743ba9
zhanqiuhu authored Apr 02, 2026

7b743ba9

[CI] Add flashinfer.py to attention test source deps (#38792) · 188defbd

Stefano Castagnetta authored Apr 02, 2026


Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

188defbd

feat(models): implement Google Gemma 4 architecture support (MoE, Multimodal,... · 08ed2b96

Luciano Martins authored Apr 02, 2026

feat(models): implement Google Gemma 4 architecture support (MoE, Multimodal, Reasoning, Tool-Use) (#38826)
Signed-off-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Signed-off-by: Luciano Martins <lucianomartins@google.com>
Co-authored-by: Luciano Martins <lucianommartins@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

08ed2b96

Bump helion dependency from 0.3.2 to 0.3.3 (#38062) · ecd5443d

Yanan Cao authored Apr 02, 2026


Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

ecd5443d

[Bugfix] Fix test mocks after SM100 restriction in #38730 (#38791) · 58262dec
Stefano Castagnetta authored Apr 02, 2026
```
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
58262dec
[FA4] Update flash-attention to latest upstream FA4 (#38690) · cb3935a8
Lucas Wilkinson authored Apr 02, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
cb3935a8
[CI][ROCm] Add gpt-oss w4a8 in CI (#38292) · 82a006be
Bowen Bao authored Apr 02, 2026
```
Signed-off-by: Bowen Bao <bowenbao@amd.com>
```
82a006be
[Frontend] Re-enable running MaxSim on GPU (#38620) · a9b4f07b
wang.yuqi authored Apr 03, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
a9b4f07b

Triton MLA perf fixes (#33529) · d9408ffb

Koushik Dutta authored Apr 02, 2026


Signed-off-by: Koushik Dutta <koushd@gmail.com>
Co-authored-by: root <root@ubuntu-nvidia.localdomain>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

d9408ffb

[Bugfix] Enable batch-invariant Triton matmul on all Ampere GPUs (SM 8x) (#38427) · 16a65e41

Yusuf Mohammad authored Apr 02, 2026


Signed-off-by: yusuf <yusufmohammad@live.com>
Signed-off-by: yusuf <yusuf@deeplearningmachine.mynet>
Signed-off-by: Yusuf Mohammad <79484377+YM2132@users.noreply.github.com>
Signed-off-by: <>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: yusuf <yusuf@deeplearningmachine.mynet>

16a65e41

[Model] Add support for Cheers multimodal model (#38788) · c0817e4d

bsliu authored Apr 02, 2026


Signed-off-by: bsliu <1187291748@qq.com>
Signed-off-by: 吴炳贤 <wubingxian24@mails.ucas.ac.cn>

c0817e4d

Don't compile vision encoder for Transformers backend (#30518) · dfe5e316
Harry Mellor authored Apr 02, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
dfe5e316

[Feature] KV cache per-token-head INT8/FP8 quantization (#38378) · 2ce3d0ce

JartX authored Apr 02, 2026


Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: yangyang4991 <yangyang4991@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

2ce3d0ce

[Perf] fuse kernels in gdn (#37813) · 4eefbf96
Jiangyun Zhu authored Apr 02, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
4eefbf96

[ROCm] Enable VLLM triton FP8 moe for gfx1201, tuned for Qwen3-30B-A3B-FP8... · 551b3fb3

vllmellm authored Apr 02, 2026


[ROCm] Enable VLLM triton FP8 moe for gfx1201, tuned for Qwen3-30B-A3B-FP8 tp=2 and Qwen/Qwen3.5-35B-A3B-FP8 tp=2 (#38086)
Signed-off-by: big-yellow-duck <jeffaw99@hotmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>