Commits · eb1051fb95323493d6d950c03dabac8ee56cb33e · OpenDAS / vllm_cscc

07 Dec, 2025 2 commits

[Performance] Fused blockwise quant RMS norm (#27883) · af0444bf

ElizaWszola authored Dec 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>

af0444bf

[Kernel][MoE] optimize `moe_align_block_size` (#29642) · 879ddb09

Jinzhen Lin authored Dec 07, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

879ddb09

06 Dec, 2025 1 commit

[CI/Build][AMD] Skip marlin, machete, and hadacore tests since these require... · 62079d86

rasmith authored Dec 05, 2025


[CI/Build][AMD] Skip marlin, machete, and hadacore tests since these require _C functions not defined for ROCm (#30109)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

62079d86

04 Dec, 2025 1 commit
- Access `partial_rotary_factor` from `rope_parameters` (#29966) · e10c84e0
  Harry Mellor authored Dec 04, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  e10c84e0
03 Dec, 2025 2 commits

[Kernels] Remove BatchedTritonOrDeepGemmExperts and default fallback to Triton (#29929) · 2902c348

bnellnm authored Dec 03, 2025


Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: bnellnm <49004751+bnellnm@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

2902c348

[Performance][DP/EP] Add silu_mul_per_token_group_quant_fp8_colmajor kernel (#29470) · 19bee6d1

Varun Sundar Rabindranath authored Dec 03, 2025

Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

19bee6d1

30 Nov, 2025 2 commits
- [Feat] Support non-gated activations in NVFP4 modelopt path (#29004) · 39d28108
  Omer Ullman Argov authored Nov 30, 2025
  
  39d28108
- [LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#29708) · a491b091
  Xin Yang authored Nov 29, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a491b091
29 Nov, 2025 1 commit

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

28 Nov, 2025 3 commits
- Revert "[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971)" (#29697) · 3fd1fb0b
  Huamin Li authored Nov 28, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  3fd1fb0b
- [Misc] Remove redundant attention var constants (#29650) · 33b06a6f
  Cyrus Leung authored Nov 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  33b06a6f
- [LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971) · 745a3bae
  Xin Yang authored Nov 27, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  745a3bae
26 Nov, 2025 1 commit
- [Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
  Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  430dd4d9
25 Nov, 2025 1 commit

[Perf][Deepseek] optimize gather_and_maybe_dequant_cache kernel's perf for... · 77e10c9c

Pleaplusone authored Nov 25, 2025


[Perf][Deepseek] optimize gather_and_maybe_dequant_cache kernel's perf for extremely long sequence (#28029)
Signed-off-by: ganyi <ygan@amd.com>

77e10c9c

24 Nov, 2025 2 commits
- [MoE][Refactor] Make select_experts a non-static method (#29067) · 8f066146
  bnellnm authored Nov 24, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  8f066146
- [Core] Deprecate `xformers` (#29262) · 0ff70821
  Roger Wang authored Nov 23, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  0ff70821
22 Nov, 2025 1 commit
- [CI/Build] Only use supported types and features on ROCm in MoE kernel tests (#29149) · fd65015a
  rasmith authored Nov 21, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  fd65015a
21 Nov, 2025 1 commit

[CI/Build] Fix illegal memory access and unsupported test in... · 711241c1

rasmith authored Nov 21, 2025


[CI/Build] Fix illegal memory access and unsupported test in kernels/attention/test_cache.py (#29118)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

711241c1

20 Nov, 2025 4 commits

[CI/Build] Make test_attention_selector.py run tests on correct platform (#29064) · 5e5a7eb1

rasmith authored Nov 20, 2025


Signed-off-by: Randall Smith <ransmith@amd.com>
Signed-off-by: rasmith <Randall.Smith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

5e5a7eb1

[CI/Build][AMD] Skip if flash_attn_varlen_func not available in test_aiter_flash_attn.py (#29043) · 3d84ef90
rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
3d84ef90
[Bugfix][cache_kernels]: Fix OOB in cache_kernels.cu (#28760) · fb8851f2
Vensen authored Nov 20, 2025
```
Signed-off-by: vensen <vensenmu@gmail.com>
Signed-off-by: Vensenmu <vensenmu@gmail.com>
```
fb8851f2
[CI/Build][AMD] Fix import errors in tests/kernels/attention (#29032) · 322cb028
rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
322cb028

19 Nov, 2025 6 commits

[Performance] Reduce DeepGEMM N dim restriction from 128 to 64 multiplier (#28687) · 3aaa94ac

Alexander Matveev authored Nov 19, 2025


Signed-off-by: Alexander Matveev <amatveev@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

3aaa94ac

[MoE] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#25990) · 613abb50

Shu Wang authored Nov 19, 2025


Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

613abb50

[CI/Build] Fix test_prefix_prefill for AMD (#28905) · 68d72319
Ryan Rock authored Nov 19, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
68d72319

[Feature] Prefill Context Parallel (PCP) basic support (#28718) · 2fd893b4

Qiu authored Nov 20, 2025


Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
Signed-off-by: LookAround <lixushi@huawei.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: FENP <yuanyongjie.yyj@antgroup.com>
Co-authored-by: LookAround <lixushi@huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>

2fd893b4

Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a8b70304
[Attention] FlashAttention ViT support, make default backend (#28763) · 4c23690f
Matthew Bonanni authored Nov 18, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
4c23690f

18 Nov, 2025 1 commit
- Replace `torch.cuda.Event` with `torch.Event` for better hardware compatibility (#26985) · 2a2d5d27
  Kunshang Ji authored Nov 19, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  2a2d5d27
16 Nov, 2025 1 commit
- Feature: Support Relu2 in FusedMoE fp8 cutlass path (#27261) · 03ee4811
  amirkl94 authored Nov 16, 2025
  
  03ee4811
15 Nov, 2025 2 commits
- [Misc] Make `SchedulerConfig.max_model_len` init-only (#28733) · 638e4196
  Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  638e4196
- [Performance][DeepGEMM] Estimate expected_m (#28694) · 6965ef43
  Varun Sundar Rabindranath authored Nov 15, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  6965ef43
14 Nov, 2025 1 commit
- [BugFix] Fix FA3 IMA with FULL_AND_PIECEWISE and cascade attention (default) (#28702) · db56a599
  Lucas Wilkinson authored Nov 14, 2025
  
  db56a599
13 Nov, 2025 2 commits
- [Performance][B200] silu_mul_quant: pack scales in int32 (#28358) · fe1cd770
  Varun Sundar Rabindranath authored Nov 13, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fe1cd770
- [platform] Move get_cu_count to utils (#27005) · 2dacd573
  wangxiyuan authored Nov 13, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  2dacd573
12 Nov, 2025 3 commits
- [ROCm] [Bugfix] Fix `fused_qknorm_rope_kernel` rocm compatibility (#28500) · edb59a94
  TJian authored Nov 12, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  edb59a94
- `VLLM_USE_TRITON_FLASH_ATTN` V0 variable deprecation (#27611) · 9f0247cf
  Andreas Karatzas authored Nov 11, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Andreas Karatzas <Andreas.Karatzas@amd.com>
```
  9f0247cf
- [CPU] Refactor CPU attention backend (#27954) · 7f829be7
  Li, Jiang authored Nov 12, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  7f829be7
11 Nov, 2025 2 commits
- [CI/Build] Refactor Attention backend for test_prefix_prefill from xformers to SDPA (#28424) · e5534249
  Zhewen Li authored Nov 11, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  e5534249
- [Kernel][Perf] fuse QK Norm and RoPE into one cuda kernel for Qwen Model (#27165) · 68c09efc
  zhrrr authored Nov 12, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  68c09efc