Commits · 8097591286909deb2da2e7abf3eeae0560f5be66 · OpenDAS / vllm_cscc

21 Apr, 2026 1 commit
- [Doc] Update ViT CUDA graph doc for mixed (image+video) inputs (#40355) · 80975912
  Shanshan Shen authored Apr 21, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  80975912
20 Apr, 2026 3 commits
- Update flashinfer to 0.6.8 (#39959) · 191e3fda
  bai authored Apr 20, 2026
```
Signed-off-by: bai <v@gor.io>
```
  191e3fda
- [ROCm] Add MLA dual RMS norm fusion (Q, KV) pass for DeepSeek/Kimi-K2 (#39242) · fb5635d3
  Rita Brugarolas authored Apr 20, 2026
```
Signed-off-by: Rita Brugarolas Brufau <rita.brugarolasbrufau@amd.com>
```
  fb5635d3
- [ROCm][Feature] Enable AITER MLA attention backend to work with Eagle3... · 7243e02a
  larryli2-amd authored Apr 20, 2026
```
[ROCm][Feature] Enable AITER MLA attention backend to work with Eagle3 speculative decoding on ROCm (#39616)
Signed-off-by: larryli2-amd <larryli2@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  7243e02a
18 Apr, 2026 1 commit
- [DOC] Add fuse_minimax_qk_norm (#39782) · bfde49e2
  Jee Jee Li authored Apr 18, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  bfde49e2
17 Apr, 2026 2 commits
- Fix TURBOQUANT backend selection in cuda.py (#40060) · 1174723e
  Michael Goin authored Apr 17, 2026
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  1174723e
- [Examples] Resettle Observability examples. (#40123) · 8d2cff81
  wang.yuqi authored Apr 17, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  8d2cff81
15 Apr, 2026 1 commit

[Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity (#38479) · f4b42df0

Vibhav Agarwal authored Apr 15, 2026


Signed-off-by: vibhavagarwal5 <vibhavagarwal5@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

f4b42df0

14 Apr, 2026 2 commits

[MoE] Move GPT OSS Triton kernel experts into fused_moe/experts/ (#39007) · 1a9353bb

Jackmin801 authored Apr 14, 2026


Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Co-authored-by: Robert Shaw <robertgshaw2@gmail.com>

1a9353bb

[MM][Perf][CG] Support ViT full CUDA graph for Qwen3-VL video inference (#38061) · 80118853

Shanshan Shen authored Apr 14, 2026


Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Shanshan Shen <87969357+shen-shanshan@users.noreply.github.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

80118853

13 Apr, 2026 1 commit
- [Quantization] [Refactor] Create special "GptOssMxfp4MoeMethod" (#39604) · 739e5945
  Yongye Zhu authored Apr 13, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  739e5945
08 Apr, 2026 1 commit

[MoE] Move DEEP_GEMM into experts/ subdirectory (#39005) · a776a48b

Jackmin801 authored Apr 08, 2026


Signed-off-by: Jackmin801 <ongjackm@gmail.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

a776a48b

07 Apr, 2026 1 commit
- [MoE Refactor] Split up compressed_tensors_moe.py (#38960) · b2b2c523
  bnellnm authored Apr 06, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  b2b2c523
03 Apr, 2026 1 commit

[mla] Support fused FP8/NVFP4 output quantization in MLA attention (#35792) (#36205) · 1f5ec288

Carl Y authored Apr 02, 2026

Signed-off-by: Carl You <4531192+carlyou@users.noreply.github.com>
Signed-off-by: Carl Y <4531192+carlyou@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

1f5ec288

02 Apr, 2026 1 commit

[Feature] KV cache per-token-head INT8/FP8 quantization (#38378) · 2ce3d0ce

JartX authored Apr 02, 2026


Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: yangyang4991 <yangyang4991@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

2ce3d0ce

01 Apr, 2026 3 commits
- [Bugfix] Restrict TRTLLM attention to SM100, fixing GB300 (SM103) hang (#38730) · 6183cae1
  Stefano Castagnetta authored Apr 01, 2026
```
Signed-off-by: Stefano Castagnetta <scastagnetta@nvidia.com>
```
  6183cae1
- Feature/silu block quant fusion v1 (#32996) · c09ad767
  Monishver authored Apr 01, 2026
```
Signed-off-by: Monishver Chandrasekaran <monishverchandrasekaran@gmail.com>
```
  c09ad767
- [CPU] Support head_size 512 in cpu_attn (#38676) · 36d7f198
  Li, Jiang authored Apr 01, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  36d7f198
31 Mar, 2026 1 commit
- [torch.compile] Refactor Attention Quant Fusion Pass and Remove Boilerplate (#37373) · 077a9a8e
  BadrBasowid authored Apr 01, 2026
```
Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  077a9a8e
29 Mar, 2026 1 commit
- [ROCm][CI] Fix cross-attention dispatch for encoder-decoder models (#38450) · 43cc5138
  Andreas Karatzas authored Mar 29, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  43cc5138
26 Mar, 2026 1 commit
- [Doc] Fix outdated reference to CUDAGraphManager (#38209) · a9213c0f
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a9213c0f
25 Mar, 2026 4 commits
- [ROCm]: Update rope+kvcache fusion conditions and disable custom op by default (#36716) · a0e8c740
  Rohan Potdar authored Mar 25, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  a0e8c740
- [Docs] Adds vllm-musa to custom_op.md (#37840) · 242c93f7
  R0CKSTAR authored Mar 25, 2026
```
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
```
  242c93f7
- [ROCm] Attention selector reordering (#36702) · 189ddefb
  Gregory Shtrasberg authored Mar 25, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>
```
  189ddefb
- [Docs] Add Encoder (ViT) CUDA Graphs section to CUDA Graphs design doc (#37914) · 9d0351c9
  Baorun (Lauren) Mu authored Mar 24, 2026
```
Signed-off-by: Baorun Mu <bmu@nvidia.com>
```
  9d0351c9
24 Mar, 2026 1 commit
- [Perf] Disable inductor runtime asserts by default for serving perfor… (#37485) · 82580b10
  Terry Gao authored Mar 24, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
Co-authored-by: Tianren Gao <tianren@fb.com>
```
  82580b10
23 Mar, 2026 1 commit
- [Frontend][Responses API] Fix arrival_time recording for TTFT on initial request (#37498) · 9ace378a
  Andrew Xia authored Mar 23, 2026
```
Signed-off-by: Andrew Xia <axia@meta.com>
```
  9ace378a
22 Mar, 2026 1 commit
- [MoE] Move PF Methods to Folder (#35927) · 4383f153
  Robert Shaw authored Mar 22, 2026
  
  4383f153
21 Mar, 2026 1 commit

[MoE Refactor] Mxfp4 oracle rebased (#37128) · 87bd9189

Yongye Zhu authored Mar 20, 2026


Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

87bd9189

20 Mar, 2026 1 commit

[PluggableLayer][MM] Add PluggableLayer for CustomQwen2Decoder (#37293) · 0674d1fe

Wangbei25 authored Mar 20, 2026


Signed-off-by: Wangbei25 <wangbei41@huawie.com>
Signed-off-by: Wangbei25 <wangbei41@huawei.com>
Co-authored-by: Wangbei25 <wangbei41@huawie.com>

0674d1fe

19 Mar, 2026 2 commits
- [MoE Refactor] Rename "naive" all2all backend (#36294) · 91be5f9b
  bnellnm authored Mar 19, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  91be5f9b
- [torch.compile][BE][Multimodal] Remove requirement to set_model_tag to avoid... · 7769b583
  Lucas Kabela authored Mar 19, 2026
```
[torch.compile][BE][Multimodal] Remove requirement to set_model_tag to avoid cache conflict (#37345)
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  7769b583
17 Mar, 2026 1 commit
- [Perf] Set Flashinfer sparse MLA as default backend for FP8 kv cache (#37252) · b36adfa3
  Wei Zhao authored Mar 17, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  b36adfa3
16 Mar, 2026 3 commits

[Misc] Add `float16` to `CacheDType` (#37199) · 93f3c8e5
Matthew Bonanni authored Mar 16, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
93f3c8e5
[torch.compile][BE] Modify cudagraph callable to check for is_forward_context_set (#36288) · 714c6e0e
Lucas Kabela authored Mar 16, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
714c6e0e

[Kernel] Add FlashInfer MoE A2A Kernel (#36022) · 2754231b

leo-cf-tian authored Mar 16, 2026


Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Leo Tian <lctian@nvidia.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: root <root@lyris0267.lyris.clusters.nvidia.com>

2754231b

12 Mar, 2026 2 commits

[Feature]: Remove Chunking From FusedMoE (#34086) · 2cdf9222

Xinan Miao authored Mar 13, 2026


Signed-off-by: SouthWest7 <am1ao@qq.com>
Signed-off-by: Southwest <1403572259@qq.com>
Signed-off-by: southwest <am1ao@qq.com>
Signed-off-by: Xinan Miao <1403572259@qq.com>
Co-authored-by: SouthWest7 <am1ao@qq.com>

2cdf9222

[Kernel] Add FP8 KV cache support to Triton MLA decode attention (#34597) · a1257fd1
grimulkan authored Mar 12, 2026
```
Signed-off-by: grimulkan <grimulkan@gmail.com>
```
a1257fd1

11 Mar, 2026 2 commits

Add XPU MLA Sparse backend for DeepSeek v3.2 (#33230) · e584dce5
Wuxun Zhang authored Mar 11, 2026
```
Signed-off-by: Zhang, Wuxun <wuxun.zhang@intel.com>
```
e584dce5

[Bugfix] Add Multiple of 16 block_size to triton fallback on rocm Attention to... · a40ee486

JartX authored Mar 11, 2026


[Bugfix] Add Multiple of 16 block_size to triton fallback on rocm Attention to support qwen3_5 (#35923)
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: akaratza <akaratza@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

a40ee486